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Cumulative Sum Charts 


University Durham Computing Laboratory, 
Newcastle upon Tyne, England 


This paper, presented orally the Gordon Research Conference Statistics 
Chemistry July 1960, traces the development process inspection schemes 
from the original methods Shewhart the new charts using cumulative sums, 
and surveys the present practice the operation schemes based cumulative 
sums. spite the completely different appearance the visual records kept for 
Shewhart and cumulative sum charts, continuous sequence development from 
the one type scheme the other can established. The criteria which 
particular process inspection scheme chosen are also developed and the practical 
choice schemes described. 


INTRODUCTION 


The type chart that want discuss one which used for process 
inspection and which plotted the cumulative sum the observations 
themselves some function the observations. Barnard (2) has called this 
plotting cumulative sums ‘‘a fundamental change the classical 
and perhaps is—it certainly seemed 1954 (9). spite this, however, 
now possible trace its close connection with the original Shewhart charts 
through the various modifications that have been made. should like over 
this development before talking about cumulative sum charts themselves and 
their possible future developments. 

Process inspection means different things different people; interpret the 
principal aim process inspection the furnishing information us, 
either assure that the process producing its output the specified 
manner, warn promptly that some departure from specifications 
occurring that some action may taken. This action may take many forms; 
may remedial, and perhaps also determine the destination the recent 
output; might trigger investigation for any assignable causes deteriora- 
tion quality. many applications the information from the inspection will 
required indicate the type action that necessary, the amount it. 
particular, the information from the inspection may required give 
estimate the amount departure from specification that occurring. 
the process always adjusted amount dependent such estimate 
the scheme acting servo-mechanism governing the control the process 
and will called one process control and the term process inspection will 
reserved for the earlier use. 

addition this principal aim, schemes process inspection have important 
applications when the history the process examined. hoped and 
expected that the method display the information obtained will enable 
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the occurrences trouble the process readily identified time and 
make easier the isolation the causes trouble. the other end the 
scale too, the display should similarly draw attention easily any marked 
improvements the process and isolate the causes these. are quite 
interested knowing how avoid deteriorations quality are 
learning how maintain any improvements that are noticed. While regard 
the first aim the main one, the second important that any method 
presentation the information which did not allow the latter would seem 
hardly acceptable. 


SHEWHART CHARTS 


The type control chart for process inspection which has been used over some 
thirty years basically that suggested Shewhart (15) with various modifi- 
cations and amendments that have been made since the original proposal. For 
these charts, results individual samples are plotted diagram and rules 
are given enable interpretation made easily. Possibly the principal 
value the introduction the charts was emphasize the value good 
visual presentation reinforced some sensible rules-of-thumb for making 
decisions based upon the data. the original proposals the charts were furnished 
with what may call action lines, that when any point fell outside these 
lines, some action the part those tending the process was called for. Clearly, 
with such simple rule, the samples themselves were being classed either 
good bad; the good ones where the points fell within the action lines would 
suggest that the process should continue without special attention interrup- 
tion, while the bad ones with points outside the lines demanded the corrective 
action. The main point decided for the operation such process inspection 
scheme was the position which the action lines should drawn once the 
sample size had been determined; the positions that were most frequently 
adopted were the called three-sigma limits. For example, chart for 
controlling the mean dimension process target value the lines will 
these positions because the process mean were unchanged, the probability 
that the sample mean observations would fall outside the lines and cause 
action taken 0.002, that action would taken unnecessarily the 
average only once every five hundred times. can see easily now how 
related the choice this position for the action lines was current practice 
the testing hypotheses and whatever comments and criticisms that 
may make this choice now, the pragmatic justification has been enormous. 
The contribution Shewhart’s charts the development and satisfactory 
control mass production methods must have been vital, irrespective the 
monetary savings which these charts have brought those using them many 
other different applications. When have decide the positions action 
lines now, would wish not rely three-sigma dogma but instead 
think about the costs and benefits drawing the action lines different posi- 
tions, (10). should not immediately import the positions more appropriate 
other sets process inspection continuous proceedings 
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CUMULATIVE SUM CHARTS 


being carried out long the process operated, shall wish consider the 
éffect the size samples taken and the frequency taking them upon 
the disadvantages and costs failing notice immediately departure from 
the specification manufacturing conditions, and the disadvantages the other 
hand witch-hunting process that really operating satisfactorily, but 
has chance produced bad sample. 

1950, Aroian and Levene (1) considered afresh the sort measures that 
one should use for assessing the statistical properties process inspection 
schemes. there abrupt change the quality the product the 
departure from specification need know the distribution the amount 
produced the process before the deterioration noticed the inspection 
rule are using. From this distribution detailed study the costs involved 
could made any particular case, but for general comparison inspection 
schemes, something rather simpler preferable. Such function the average 
amount produced before action demanded the inspection scheme and 
the rate which the process sampled constant, this proportional the 
average number items sampled before the action demanded. The name 
suggested Anscombe for the latter quantity was the Average Run 
Length (A.R.L.) preference Aroian’s slightly longer name. Barnard and 
Ewan and Kemp take the A.R.L. the average number samples before 
action demanded. items are sampled one one the two uses are identical, 
but each sample contains more than one item they differ. the available 
tables for the normal distribution follow Barnard’s use shall adopt here 
and note that the tables for fraction defective (9) follow the earlier definition. 
the model for the change process conditions more complex, may 
essential detailed cost analysis as, for example, Duncan (4) has done 
some cases. 

The motivation for the modifications that have been suggested the original 
Shewhart scheme can interpreted with reference such measure 
inspection scheme’s performance the A.R.L. The inspection scheme should 
able call attention quickly serious deterioration product quality 
and also notice before too long any slight but sustained deterioration. 
slight deterioration would shown the Shewhart chart with action lines 
sequences points departing consistently from the target value, but perhaps 
insufficiently extreme fall outside the action lines. Consequently, warning 


lines were proposed which would drawn within the action lines perhaps 
the two sigma limits, 


e.g. for the mean 


with addition the rule that out the last points fall between the 
warning and action lines, then investigation would demanded. This sort 
scheme has steeper average run length function when plotted against the 
size the departure from target value than the original Shewhart scheme, (12). 
Some other rules use runs points the control chart, for example, Moore 
(8) Weiler (19-21) consider rules the type, “If consecutive points 
the chart fall outside control lines, take action”. 

Schemes like this have certain advantages over those based one sample 
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point only. They have the practical one requiring only small samples; and 
they detect large changes with the speed small samples and small changes 
well the single point rule with large samples. There has been certain 
‘amount work (10, 19, 20) the best choice rule and the positions 
the control lines.* 

seems that these modifications have been prompted the realization 
that the charts contained much more information than was being used 
one-point rule. Instead these new rules were designed take into account part 
the information contained the chart for fixed number samples the 
immediate past. 

The next step—which does not seem such big one since Wald’s introduction 


fixed number past samples should considered taking the decision. 
the same time, can done easily would like scheme which will take 
into account the actual positions the points the chart and not merely the 
classifications into which division the chart the point falls. The cumulative 
sum charts indeed possess these properties and show them the simplest 
possible way want consider controlling the mean distribution against 
one-sided deviations from the target value only. Practical cases might the 
proportion defective items the range sample given size—I know 
that shall often want know about deviations the “improvement” 
direction but for now consider only the departure one direction—a de- 
terioration. 

Suppose that wish control the population mean target value 
and that take observations the course our process inspection. 
then plot 


S, > (a; k) 

the chart where value” related the target value will 
such that the mean path downwards (or horizontal) for good quality and 
upwards for bad. will take here and return its choice later. Naturally 
only need add the deviation from the reference value the last point 
recorded each time. With this chart have immediately picture the 
behaviour the sample means stretching back over the last point, last 
lines joining the current point the sample points far back like. 
are concerned about departures from specifications greater than the target 
value, want know when the cumulative sum path the chart takes 
upward turn. The easiest type action rule adopt action the 
current sample point rises more than stated amount, above the previous 
lowest point the sample Thus this rule takes into account the actual 
sizes the departures and also makes immediately apparent all the recent 
evidence about possible change the population mean. 


Work similar that (12) reported Roberts, Bell System Technical Journal, 
87, 1958, 83. 


sequential methods hypothesis testing—is relax the restriction that only 
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CUMULATIVE SUM CHARTS 


Before leaving the Shewhart type chart there another connection between 
these charts and cumulative sum charts that want mention. When there 
are both warning and action lines Shewhart chart the samples are really 
being classified point beyond the action lines, point 
between action and warning lines, within the warning lines. 
Under the rule “Take action one point falls outside the action lines out 
the last points fall between control lines and action lines” are demanding 
action one “‘Bad” sample occurs too many ones occur within 
the last samples. For the application these rules only necessary 
count the number points the different regions, but order see which 
these rules equivalent the cumulative sum procedure, convenient 
introduce scoring system. example, consider the rule where 
that three consecutive points outside the warning lines give 
the same signal one outside the action lines. assign scores the samples 
2,+ for “Good,” “Doubtful” and “Bad” points respectively 
the rule action the cumulative sum rises more above its 
equivalent every way the rule expressed terms warning 
lines. easily seen that occurrence point least pulls the cumu- 
lative sum path its previous minimum and satisfies the conditions the 
rule about consecutive doubtful points only being regarded important. More 
generally can shown (12) that warning line rules the above type for 
are equivalent cumulative sum rules applied the scores. follows that 
many the amended Shewhart rules that are now use are fact equivalent 
restricted type cumulative sum rule. However, the full advantages are 
not being obtained; the use the actual observations and the easy and vivid 
visual picture cumulative sum chart are both missing. 


CUMULATIVE CHARTS 


The operation cumulative sum charts practice very similar the 
operation the usual charts. The differences are the type visual record 
made and the criteria for deciding take action. necessary take some 
care with the plotting the cumulative sums because they can extravagant 
with the paper—paper cheap but the record covers too great area some 
inconvenience results. This can easily avoided with charts for one-sided 
deviations; suppose wish detect positive shift the process parameter— 
the mean say. Then the mean path the sum 
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will take turn upwards the process mean increases above Any negative 
increments, and parts the path pointing downwards will give 
little indication increase. long the path tending downwards 
are satisfied with the value the process mean and there need keep 
the cumulative sum going more and more negative. start 
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can record long positive and plot the chart, taking action 
the Alarm value, reached; when falls below zero, start the cumulative 
sum afresh zero, and again restart zero after action has been taken. This 
method plotting the chart using the identity the rule with the repeated 
application Wald sequential test with boundaries and with starting 
point always the acceptance boundary. keep applying the test until 
one ends the upper boundary and then take action. (Incidentally, this points 
out another connection with the Original Shewhart Chart—that was equivalent 
the repeated application fixed sample size tests). 

The other quantity needed decide what rise, the cumulative sum 
path should demand action. the statistical model the production process 
known both its normal target state and all its possible departure states 
would possible derive mathematically the optimum value These 
conditions full knowledge are likely met only rarely and instead need 
look for values likely satisfactory not best under quite wide 
ranges circumstances. course, one value will not necessarily suffice 
for all applications, but can take heart from the experience with the classical 
control charts that the three-sigma limits which Shewhart had the wisdom 
suggest served well for many people. want proceed this way 
can select our schemes based their average run length function. For 
example, when the process control and samples are independent, Shewhart 
chart with just three-sigma limits has average run length 500; this corresponds 
unnecessary interruption controlled process the average every 
500 samples. 

Charts for two-sided deviations need take into account departures the 
cumulative sum from the mean path both upward and downward directions. 
Originally suggested that should apply two one-sided schemes simul- 
taneously, one detect increase and the other decrease, but the difficulty 
finding the A.R.L. caused look for alternative procedures. However, 
Barnard has re-presented the scheme using masking device and Goldsmith 
and Whitfield have evaluated Monte Carlo method the A.R.L.’s for several 
schemes (2), (6). The method follows: 

Plot the cumulative sum where the target value. Then 
place the chart V-shaped mask with angle 26, its vertex distance 
from the current point and its axis horizontal. all the previous sum path 
visible, continue without interrupting the process. part the path disappears 
under the upper arm the mask then the process mean has decreased below 
its target value. The two quantities giving the shape and position the mask, 
and can chosen give the scheme desired characteristics. return 
the method choice the next section. 

These cumulative sum schemes are much more sensitive than the ordinary 
Shewhart ones, especially moderate deviations from the target. For the 
same A.R.L. the target value the A.R.L. cumulative sum scheme 
deviation about one can one quarter that Shewhart scheme. 
This sensitivity advantage for processes needing precise control, but 
definite drawback where some slack the process permissible. these 
cases, cumulative sum charts should not used should used with greater 
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thought. easy see that continued production value away from the 
nominal target will cause much more frequent interruption the process 
the sum chart although the quality production acceptable; some extent 
the nuisance can avoided choosing scheme with very large A.R.L. 
nominal target value the centre the region. 


CHOICE SCHEME 


The use three-sigma limits with Shewhart charts became dogma and 
would unfortunate similar sort dogma were arise for cumulative 
sum charts. the employees one world-known company are urged, the 
best way Following this injunction, need first decide upon 
two values the process parameter the target value and that 
value which regard the process operating satisfactorily and conse- 
quently wish only rare interference with the process; and value the 
process parameter that regarded bad and should noticed quickly. Next 
should decide upon the desired values the A.R.L. and these 
parameter values; tells how frequently can tolerate interference with 
satisfactory process and says how long can before deterioration 
Should noticed. Usually will quite large, the order 250 1000, 
while will small, less than about 10. 

Graphs the A.R.L. for schemes for controlling the mean normal distri- 
bution against two-sided deviations have been constructed Goldsmith and 
Whitfield (6) and tables and nomogram have been prepared for the one-sided 
case Ewan and Kemp (5). the latter paper the authors use approximate 
solutions the integral equations arising from the defining Wald test (7, 11), 
have derived empirical approximation the A.R.L. and have shown 
that instead plotting the cumulative sum deviations from the target value, 
its maximum for given A.R.L. The empirical approximation for the 
A.R.L. when the observations have unit variance 


that both defining characteristics the one-sided cumulative sum scheme, 

When are dealing with other distributions, for example, controlling the 
normal population using the range mean range samples, the 
above approximation for the A.R.L. poor quality may used and good 
quality the tabled results for the normal mean will satisfactory approxi- 
mation. Naturally these applications the will refer the mean the 
distribution the statistic concerned and the this distribution will 
also required; the example above, would use the mean and 
the range distribution given, e.g. Pearson’s tables. 

Tables schemes for controlling the fraction defective process calculated 
using the Wald test exact results (3, were given A.R.L. these 
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tables the average number observations and not samples. Detailed examples 
the choice schemes based the above principles are given the papers 
cited. 


DETAILS 


Since such emphasis placed the visual impact these schemes some 
attention needs paid the scale which the charts are plotted. are 
looking for change the direction the mean path cumulative sum and 
some experiments Barnard have shown that changes mean moderate 
amount are most easily noticed when one horizontal step about equal 
step vertically. similar conclusion has been reached independently 
Truax (17). 

The above applications cumulative sum charts process control follow 
those the Shewhart chart quite closely and them they are more precise 
and sensitive operation and more easily interpreted visually. The other most 
important requirements the charts kept process inspection scheme 
the post mortem examination results. This phase usually concerned 
with test and estimation problems; did process change occur the time 
covered the given records, and so, what kind change, how much and 
when (13,14)? Again, cumulative sum procedures compare well with Shewhart 
ones. The point change shown much more clearly sum chart 
change the direction the mean path than the classical chart 
slight difference the mean level set points. 


Run 


the case one-sided schemes has been shown (9, that the distribution 
the run length will approximately geometric when the A.R.L. large. 
The scheme equivalent the repetition Wald tests; the number repe- 
titions the tests has geometric distribution and when the A.R.L. large 
this dominates the form the distribution the number samples. Page 
showed that the distribution the run length, approximated for large 


where n/N, and where are respectively the and A.S.N. con- 
ditional upon acceptance the defining Wald test. use the result that 
the A.R.L., given 


where the unconditional and put obtain Kemp’s result 


Thus for the one-sided case least and for large, the run length distribution 
specified completely the A.R.L. and have good justification for 
using the A.R.L. choose our schemes. 
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CUMULATIVE SUM CHARTS 


The cumulative sum charts can used and are being used they stand; 
but they have already suggested several areas which further work would 
rewarding. The problems estimating the position and the size changes are 
worth more attention. The effects correlated observations have been examined 
one case Goldsmith and Whitfield; wider study desirable. The problems 
inspection procedures are related the whole field control methods and 
need know how action based upon cumulative sum and Shewhart charts 
affects the process. Different criteria choice scheme will relevant and 
different rules for indicating action and its amount may appropriate; rules 
with curved boundaries may most satisfactory. There will smaller problems 
arising from minor modifications the inspection schemes; can scheme for 
controlling both mean and the same chart constructed possible 
warning line chart (12); can other quick methods for example, gauging 
(16) applied the inspection schemes which lose little efficiency and give 
much convenience application? 
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Average Run Lengths Cumulative Chart 
Quality Control Schemes 


Imperial College, London 


Average run lengths are evaluated for V-mask quality control schemes based 
cumulative deviation charts when the observations are Normally distributed and 
either independent members certain serially correlated class. 


CuMULATIVE CHART SCHEMES 


The Shewhart quality control chart with fixed control lines suffers from the 
disadvantage that the observations are viewed independently, account 
being taken runs observations all higher all lower than the long-term 
mean the process. This results relative insensitivity moderate changes 
the short-term mean value. For example consider chart with fixed limit 
lines controlling the mean Normal population constant 
variance, there average run length about single observations 
before shift current mean one standard deviation from the long-term 
mean detected. 

This situation can improved having warning lines 1.96¢ addition 
the action lines Further schemes have been devised with alterna- 
tive positions for the control lines, some taking account runs observations 
above (or below) the long-term mean. For example Page (4) considers rules 
the type “‘take action any point falls outside the action lines any out 
the last all outside the warning lines.” However such rules are 
inefficient compared with control schemes based cumulative charts. Page 
(3) assigns score the jth observation and plots cumulative score, 


S, 

The system scoring chosen that the mean path the chart 
downwards when quality satisfactory and upwards when quality un- 
satisfactory. For one-sided control scheme, Page adopts the rule “take action 
after the nth observation Min. and for detecting changes 
either direction suggests action after the nth observation either 
intervals, and h’, are positive constants. discusses the calculation average 
run lengths for both these schemes. useful amendment these rules has 
been proposed Ewan and Kemp (2), who form cumulative sums the 
differences observations from reference level mid-way between the accept- 
able and rejectable quality levels. These values are plotted only when the 
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cumulative difference relevant towards taking decision that quality has 
changed adversely. 
Following essentially the same procedure, Barnard (1) takes 


for the cumulative score where the algebraic difference between the jth 
observation and the long-term process mean, and the corresponding chart 
perhaps best termed ‘cumulative deviation chart’. From this definition, 
follows that changes process mean are reflected proportionate changes 
the average slope the cumulative graph, the mean path being horizontal 
when the process target. Trends the process mean which are not easily 
discernible Shewhart chart show remarkably clearly cumulative 
deviation chart, though certain amount care needed avoid being misled 
trends which are only apparent. 

For two-sided control scheme based this chart, symmetric V-shaped 
mask advocated with the vertex the pointing horizontally forwards and 
distance ahead the current point (n, S,). This shown Figure 


-V- MASK 
CUMULATIVE 


RRENT POINT 
DEVJATION 


NUMBER 
OBSERVATION 


1—V-mask superimposed cumulative deviation chart. 


the angle between each the limbs the and the horizontal. The 
can etched perspex sheet and the sheet moved into the correct position 
each value plotted the cumulative chart. lack process control 
indicated when previously plotted point falls outside the limbs the V-mask: 
the origin counts previous point for this purpose 0). The graph 
recommenced appropriate correction made when the process mean 
reset after out-of-control warning. virtue their simplicity very 
straight-forward operate such schemes the chart-room manufacturing 
plant, and indeed the plotting may carried out suitably adapted auto- 
matic recorder. 

Page (5) has derived similar test procedure with assuming that the 
size the change the process mean (if occurred) was known. 
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AVERAGE RUN LENGTHS QUALITY CONTROL 


The behaviour the Barnard control scheme depends the two parameters 
One way selecting the proper parameter values for particular appli- 
cation try out variety masks historical records. The shape the 
mask adjusted that past changes the current mean are deduced 
reasonable time, whilst avoiding the alternative trouble giving indications 
lack control when the fluctuations are really due chance error. However, 


this method subjective, and may preferable decide two desired 
average run lengths: 


when the process target, and 

when the current mean off target, 
and determine and accordingly: the standard error the sample 
means, assumed known and constant. the rate which samples are taken 
constant, the average run length measure how much the output 
suspect quality, and may used one simple criterion for comparing 
different schemes. Hence average run lengths, have been calculated for various 
values and with the range These values will enable the statis- 
tician assess the behaviour V-mask plans use and will facilitate the 
design suitable control schemes. 

This paper does not discuss directly the important use cumulative control 
chart method for estimating the current mean the process. This may 
achieved superimposing parabolic quartic mask the chart; the vertex 
the mask placed over the current point and the axis rotated 
include the maximum number consecutive past points within the the 
mask. This gives greater weight the more recent observations, and the final 
direction the mask axis corresponds the estimated current mean (1). 


AVERAGE LENGTHS FROM INDEPENDENT OBSERVATIONS 


The choice will also depend the scale used when plotting the cumu- 
lative deviation chart. For purposes standardisation, has been assumed 
that the plotting interval the horizontal axis equal the vertical 
axis, that when the current process mean shifts from the target, the mean 
path the cumulative graph will make angle 45° with the horizontal. 
This arrangement permits rapid visual appreciation the behaviour the 
process from the appearance the cumulative graph. When the plotting interval 
the horizontal axis equal the vertical axis then the values 
tan given below should multiplied 

assumed throughout that the observations (means samples) come 


from Normal population further assumed this section that 
the observations are mutually independent. 


Figures and graph average run lengths, (on logarithmic scale) 
against the displacement the current mean for masks with lead 
and units respectively, where the unit the plotting interval the 
horizontal axis. The values tan have been chosen give range 
from 1500, and the graphs may interpolated. will seen 
that certain combinations and have similar characteristics. The evaluation 
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2—Average run length Displacement current mean for symmetric V-masks 
with 
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DISPLACEMENT OF CURRENT MEAN ——> 


3—Average run length Displacement current mean for symmetric V-masks 
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run length Displacement current mean for symmetric V-masks 
with 


was carried out Monte Carlo simulation Ferranti ‘Mercury’ digital 
computer: sequence pseudo-random Normal deviates was generated 
fast table look-up procedure. Each calculated has coefficient variation 
less than per cent, accuracy which regarded adequate for practical 
purposes. 


The results may also expressed terms two empirical formulae 
follows: 


The first these equations provides good approximation for all the 
values and investigated, and the second evaluates adequately when 

Suppose, for example, require 500 when the process target 
satisfactory. interesting note that the corresponding standard Shewhart 
chart with control lines either side the long-term mean has 500 
but 55, exemplifying the power the cumulative chart scheme. 

comparison average run lengths between standard Shewhart and cumu- 
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run length Displacement current mean for symmetric V-masks 
with 


lative deviation schemes shown Figure for two typical V-masks, the 
width the Shewhart control lines being chosen give approximately 
equal values for each case. The data are listed Tables and 

The power the cumulative scheme most evident for moderate deviations 
the current mean: reduction factor the average run length possible 
with the first these two masks. Exceptionally large changes are picked 
little more quickly the Shewhart chart. may sometimes better plot 
Shewhart chart and cumulative deviation chart simultaneously obtain 
picture the process variation. 

The values may also used derive the average run lengths the 
two-sided scheme proposed Ewan and Kemp (2). For can shown that 


Deviation current mean 
Average run 


Cumulative 
Scheme 319 42.3 9.23 3.50 2.09 1.59 1.21 
Shewhart 


Scheme 
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CONTROL SCHEME 
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average run lengths between Shewhart and cumulative schemes. 


the behaviour symmetric V-mask scheme statistically equivalent 
pair adjoint decision interval plots. points the latter charts are derived 
from the means samples size having within sample standard deviation 
then the relationship between the parameters the two schemes given 
the equations 


, 


TABLE 
tan 0.40 Equivalent control lines +2.14¢ 


Deviation current mean 


Average run 
Cumulative 
Scheme 30.7 13.9 5.84 2.04 1.30 1.05 1.005 
Shewhart 
Scheme 30.5 18.1 7.75 2.24 1.24 1.03 1.002 
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7—Average run length Serial correlation coefficient for symmetric V-masks with 


where and the decision interval the Ewan and 
Kemp scheme. The average run lengths are related the reciprocal rule: 


where the A.R.L. the V-mask scheme, the A.R.L. the upper 
decision interval plot, and the A.R.L. the lower decision interval plot. 


Errect SERIAL BETWEEN THE OBSERVATIONS 


practice, industrial plant observations are often serially correlated, 
that important know how serial correlation effects the values Corre- 
lated pseudo-random deviates from were therefore generated 
according the first order autoregressive sequence: 
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When have the case independent observations considered above. 
When 


forall 
and follows that the average run length infinite. When 


this leads when the deviation the current mean less than equal 
tan but for larger deviations the finite average run lengths can 
lated from tables the Normal probability integral. 

Figures and graph the average run length against the coefficient for 
various deviations current mean: Figure for the V-mask with lead dis- 
tance units and tan 0.4 (on the scale above), and Figure 
refers the V-mask with the same lead distance but tan 0.5. There 
even integer. will seen that for large deviations the current mean 
the serial correlation has little effect except near But when 
small, positive correlation the process increases the effectiveness the cumu- 
lative chart control scheme (halving the average run length some cases), 
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8—Average run length Serial correlation coefficient for symmetric V-mask with 


| 


| 
she 
| 


while negative correlation leads higher average run lengths. These curves 
may regarded typical. 

When the value known can estimated for some process 
desired control, the corrected values the average run length should used 
deciding the appropriate values and the case positive correla- 
tion this will avoid troubles due too frequent interruption into satisfactory 
process. 

The authors acknowledge with thanks discussions this paper with Professor 
Barnard Imperial College, London. 
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Prediction Regions for Several Predictions 
from Single Regression Line* 


Stanford University 


When linear relationship has been fitted least squares, the methods for 
prediction interval for the response some fixed value the independent 
variable are explained many statistical text books. This paper describes the some- 
what more complex problem determining the joint prediction interval for the 
responses each separate settings the independent variables when all 
predictions must based upon the original fitted model. 


Determining the relationship between several variables problem which 
often arises engineering. particular, relationship the form 


data. More important, however, these results are used make statements 
about future values for given values the X’s. For example, consider the 
following simple situation. The speed missile critical factor, which 
determined only measurement after firing. the other hand, the orifice 
opening the valve which admits the fuel easily obtained bench tests. 
Suppose that there exists underlying relationship between these two variables 
the form 


Average value speed (orifice opening). 


Hence, speed corresponds and orifice opening corresponds 
the above linear relationship. missiles are produced and fired that 
Estimates and are obtained, usually the method least squares. 
new missile produced prediction its speed based knowledge 
its orifice opening may desirable. The usual techniques can used obtain 
prediction interval such that the speed the missile, having given orifice 
opening X*, will lie the interval with preassigned probability, say 0.95. 
Expressions for such obtained from any standard 


Work done under the sponsorship the Office Naval Research under Contract 
onr-25126. 

For example, see Chapter Engineering Statistics Bowker and Lieberman, Prentice 
Hall, 1959. 
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more difficult problem arises when additional missiles are produced 
(rather than one), and prediction region desired for the speeds given 
the orifice openings and based the original pairs observations. Using 
the results for the one missle times incorrect since the prediction intervals 
are not independent. They are all based upon the same original observations. 
the purpose this paper give three methods for obtaining prediction 
region for future observations based upon the same esti- 
mated linear regression given the values the independent variables 


II. Exact REGION 


variables with 


Ely.) Bo + Bi X10 + + 
and 
Define 
N 


spectively. Let 


fixed value the vector 
and 
Then the covariance and given 


where the element the ith row and jth column the inverse matrix 

Denote the future rth observation corresponding the vector 
The quantities are normally distributed random variables with 
zero expectation and covariance 


Let 


the matrix covariance and variances for the random vari- 
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PREDICTION REGIONS FROM SINGLE REGRESSION LINE 


ables (y* From (1), (2) and (3) follows that 


t=1 j=1 


j=] 


Thus (y* has multivariate normal distribution with zero mean and 
covariance matrix Let 


K K 
where the element the rth row and sth column the inverse matrix 


N 
degrees freedom. follows, therefore, that the quantity 


K K 


pendent Thus for any level significance the equation 


U < Fa:x.w-p-1 


prediction region easily ascertained substituting these values into the 
expression for and determining whether the result less than equal 
F a;K,N~p-1 


III. APPROXIMATE PREDICTION REGIONS 


The prediction region given the previous section clearly ellipsoid. Al- 
though this ellipsoid yields exact prediction region, its interpretation may 
difficult. Often, one interested prediction regions which are intervals for each 
future observation. This section describes two such regions. Both these 
regions will approximate that the probability will least that 
they contain the future observations yk. 


Following the notation given Section II, exact prediction interval for 


t=1 j=1 
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degrees freedom. Suppose there are now future observations and the above 
prediction interval used for each (varying the value the independent 
variables each time course) replacing The probability 
that all the future observations fall into their respective intervals 
least a). This easily seen taking the special case Let 
the event that the first future observation falls outside its prediction interval, 
and let the event that the second future observation falls outside its 
prediction interval. Then the failure the pair intervals simul- 
taneously bracket the two future observations. Choose P(A) P(B) a/2. 
Hence 


then follows that the probability that both future observations simultaneously 
fall into their prediction intervals least 

The second prediction region obtained circumscribing rectangular 
region about the ellipsoid. Since this rectangular region includes the ellipsoid, 
the probability will least that contains the future observations 
The values the end points the intervals which describe 
the rectangular region are easily obtained. has pointed out that 
ellipsoid can generated tracing out all the supporting hyperplanes. 
particular, the region interest can described small subset these 
hyperplanes; namely, those which occur the maximum and minimum the 
ellipsoid. These supporting hyperplanes lead the following intervals for the 
future observations 


This set intervals generates the rectangular region which circumscribes the 
ellipsoid. 


IV. EXAMPLE 


Consider the example mentioned earlier about predicting the speed 
missile from measurement its nozzle opening. Suppose pair observations 
are taken and are given below 


speed (miles/hr) 5,940 5,550 5,070 4,520 4,360 
opening (inches) 1.40 1.36 1.34 1.32 1.31. 


two more missiles are produced having nozzle openings 1.37 and 1.33 inches 
respectively, 90% prediction regions using the three methods given this 
paper are follows: 


Exact Method. 


The least squares estimates and are given 


For example, see The Analysis Variance Scheffé, John Wiley, 1959. 
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18273.44 


i=1 


and 


that the equation the estimated line 


The variance and covariance matrix given 


Furthermore 


where 
and 
Hence 


—0.176 


The prediction region then given 


5.46 


This ellipse plotted Figure 
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Speed in Miles/Hr. of Second Future Missile (y 
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Ficure 1—Prediction regions for two future missiles having nozzle openings 1.37 and 
inches respectively. 


Approximate Methods. 
For the first approximate method the prediction interval for given 


The prediction interval for given 


[4205, 5386]. 


The probability that both future observations fall within their respective 
intervals greater than 0.90. This region shown the dashed inner rectangle 
Figure 

For the second approximate method (prediction region which circumscribes 
the ellipsoid), the prediction interval for given 
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6155]. 


The prediction interval for given 


[4183, 5409]. 


The probability that both future observations fall within their respective 
intervals greater than 0.90. This region shown the solid outer rectangle 
Figure 


REMARKS 


rather surprising that the exact prediction region given the ellipse 
does not lie totally within the rectangle obtained from using the first approxi- 
mate method. This approximation appears crude. small (five) this 
example that the prediction for the future observations strongly dependent 
upon the estimate the initial regression line. were this approximate 
method would expected give good results since the regression line would 
‘‘essentially” known. the regression line known exactly, this approximate 
method becomes exact. 

Only the situation where the ellipsoid lies totally within the rectangle 
obtained from the first approximate method the second approximate pro- 
cedure desirable. This procedure circumscribes the ellipsoid and easy use. 
fact, both approximate procedures have the advantage ease computation. 
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The Robustness Life Testing Procedures 
Derived from the Exponential Distribution 


National Bureau Standards 


Almost all the statistical procedures current use for evaluating the reliability 
components equipment rest the assumption that the failure times follow the 
exponential distribution. However, practical situations one rarely has enough data 
determine whether failure times are actually exponential. This paper studies the 
behavior several statistical life testing procedures based the exponential failure 
law the true failure law the Weibull distribution. found that these statistical 
techniques, which are widely used, are very sensitive departures from initial 
assumptions. Applying these techniques life test data when the exponential failure 
law not satisfied may result substantially increasing the probability accepting 
components equipments having poor mean-time-to-failure. 

This paper also develops convenient analytic techniques for approximating (i) 
the distribution sums independent random variables, and (ii) the characteristics 
sequential procedures, for non-negative random variables. These techniques are 
based general life distribution which consists expansion generalized 


Laguerre polynomials. Application these methods the Weibull distribution 
yields excellent results. 


INTRODUCTION 


the present time there wide interest the life testing components 
equipments where the time-to-failure time-between-failures assumed 
follow the exponential distribution. recent report [1], often referred 
the AGREE report, contained the findings two task groups which presented 
statistical procedures for evaluating the reliability components equip- 
ments from life tests. Lieberman [12] has recently presented host sequential 
life testing procedures similar those presented the AGREE report. Much 
the statistical theory which these procedures are based was developed 
series papers Epstein and Sobel [5, 8]. Their papers contain 
work dealing with several different types life testing plans.** 

The key assumption underlying almost all the statistical procedures associated 
with life testing that the failure times follow exponential distribution with 


Also the University Maryland.. 

The Department Defense has recently published handbook life testing plans 
based the exponential distribution. The handbook was released after this manuscript was 
galley; the reference is: 

Sampling Procedures and Tables for Life and Reliability Testing (Based Exponential 
Distribution), Quality Control and Reliability Handbook (Interim) H108, Office the 
Assistant Secretary Defense (Supply and Logistics), 1960. 
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probability density function and cumulative distribution function 


respectively. The function usually referred the reliability func- 
tion failure law, will denoted i.e., 


practical situations one rarely has enough data verify that the ex- 
ponential failure law truly characterizes the data. Instead hoped that any 
deviations from exponential theory will not seriously affect the procedures 
which are derived from it. Statistical procedures which are insensitive de- 
partures from basic assumptions have been termed cf. Box and 
Anderson [3]. 

the purpose this paper investigate the robustness four repre- 
sentative acceptance sampling procedures derived from the exponential distri- 
bution when, fact, the failure times follow Weibull distribution with the 
same mean life. This done constructing the operating characteristic (O.C.) 
curves for these procedures when the parent distribution failure times the 
Weibull distribution having the reliability function 


for values the shape parameter 3/2, and 

The Weibull distribution belongs class distributions which character- 
ize failure, e.g., the longer the item has been used, the greater the 
probability failure. has been successfully applied studies the re- 
liability vacuum tubes, cf. Kao [11]. Further, difficult distinguish 
between and the exponential distribution for small sample sizes. illustrate 
this, Figure depicts the empirical reliability function, plotted semi-log- 
arithmic paper for samples 15, and drawn from the exponential and 
various Weibull distributions. One would expect the plotted points approxi- 
mate straight line only the failure times actually follow exponential 
distribution. Note that the Weibull and the exponential data are indistinguish- 
able almost all cases. Further discussion detecting departures from the 
exponential distribution contained Appendix 


PRINCIPAL RESULTS AND METHODOLOGY 


Quality items undergoing life tests usually designated specifying 
the mean-time-between-failures (MTBF) mean failure time. choosing 
appropriate procedure for evaluating life tests one must take into account 
(i) the probability rejecting items which come from process having the 
desired MTBF (termed the producer’s risk); and (ii) the probability accept- 
ing items coming from process with sub-standard MTBF (termed the con- 
sumer’s risk). 
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ROBUSTNESS LIFE TESTING PROCEDURES 


SAMPLE SIZE 


RANDOM SAMPLES FROM POPULATIONS HAVING RELIABILITY FUNCTION 
WHEN E(t)= 1000 


The report Task Group AGREE [1] recommended statistical pro- 
cedure for life tests which would result (i) rejecting items having the desired 
MTBF with probability .10, and (ii) accepting items having half the 
desired MTBF with probability .10. our investigation have employed 
procedures using these risk levels. For purposes exposition have taken 
the desired MTBF 1000 hours. 

The four life testing plans studied are (1) fixed sample size, (2) fixed sample 
size with censoring, (3) truncated non-replacement and (4) sequential. These 
procedures essentially emanate from the works Epstein and Sobel and are 
discussed sections 

The O.C. curves for the fixed sample size and the sequential plans wore 
obtained analytical methods which are described Appendix Aside from 
their use robustness studies, these analytic methods give good approximations 
(i) the distribution sums Weibull random variables and (ii) the 
curve and average sample number for sequential tests made sums Weibull 
random variables. The results for the truncated non-replacement plan were 
calculated theoretically. For the fixed sample size plan with censoring, individual 
points the curves were obtained empirically simulating the testing 
procedure computer. Each point was based 1500 simulated life tests. 
This method empirical sampling was also used check some the 
curves obtained analytic methods. 


2.1 Fixed sample size plan 


Following well-known procedure, components are placed test simul- 
taneously, and the test continues until all components fail. 
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denote the failure times ordered magnitude, then the components 
are accepted rejected according the decision rule: 


accept 
reject 


When 14, the risk levels .10 and .10 are obtained for 
Let the failure times have Weibull reliability function (4) with mean i.e. 


1/p 
Then the probability acceptance, Pr{6,,, C}, can approximated 


where rp, rCp/m, are Laguerre polynomials defined (12), 
and the constants are given (28) and tabulated (49). (The derivation 
(7) discussed Appendix I). 

The individual points the O.C. curves drawn Figure were calculated 
using (7) with check the accuracy this approximation was made 
simulating 1500 life tests each three samples drawn from populations 
having mean-time-to-failure 500, 750, and 1000 hours. These results are 
summarized Table The agreement excellent and well within the sampling 
error the simulations. 


2.2 Fixed sample size plan with censoring 


The fixed sample size procedure can modified placing components 
test simultaneously and discontinuing the test after the rth failure. 
this case the decision rule is: 


accept 
r . 
reject 


where denote the failure times. This procedure was 

Epstein and Sobel show that when the failure times follow the exponential 
distribution, the distribution 6,,, identical with the distribution 
Hence the operating characteristic curve based the lowest out ordered 
observations identical with that based out observations. 


denotes the upper percentile the chi-square distribution for degrees 
freedom. 
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CURVES FOR FIXED SAMPLE SIZE 
PLAN BASED EXPONENTIAL DISTRIBUTION 
WHEN PARENT DISTRIBUTION ACTUALLY 
WEIBULL WITH 


PROBABILITY ACCEPTANCE 
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CURVES FOR FIXED SAMPLE SIZE PLAN 
WITH CENSORING BASED EXPONENTIAL 
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The operating characteristic curve shown Figure was obtained entirely 
empirical sampling. These sampling results are summarized Table 

clear that the operating characteristic curves for the censored and un- 
censored cases are very different when the failure times follow Weibull distri- 
bution instead the exponential. The censored procedure seems particular- 
sensitive departures from exponential assumptions. fact, when 
the probability accepting components with mean failure times between 500 
and 1000 hours great that such components are almost always accepted. 


2.3 Truncated non-replacement plan 


truncated non-replacement plan consists placing components test 
simultaneously and stopping the test after either preassigned time after 
the rth failure time, whichever occurs sooner. 


denote the failure times, then the decision procedure is: 


Let R(T) denote the probability that component survives time Then 
the probability that sample size has least failure times larger than 
(when the mean failure time the probability acceptance; i.e. 


GURVES FOR TRUNCATED 
PLAN BASED EXPONENTIAL DISTRIBUTION 


WHEN PARENT DISTRIBUTION ACTUALLY 


WEIBULL WITH 
.40 
.20 
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where (a, the incomplete beta function. 

Assuming the exponential reliability function R(T) exp and taking 
28,r 14, and 504 hours, find that 


L,(1000) 0.900 
0.095 


which correspond the chosen consumer and producer risks. (The consumer’s 
risk 0.095 rather than 0.100 due the necessity being integral). 

Hence easy matter construct the operating characteristic curve 
this procedure for any parent distribution substituting the appropriate 
reliability function for different values equation (9). The O.C. curves 
for Weibull parent distributions using R(T) exp are portrayed 
Figure Note that like the censored case, the O.C. curves for the Weibull are 
widely separated from that the exponential indicating particularly non- 
robust procedure. 


2.4 Sequential plan 


The simplest application sequential testing procedure consists testing 
the components one time. After each failure decision made either 
accept reject the components, run another test. 

Let represent the failure times which are not necessarily 
ordered magnitude. The sequential procedure used here sequential prob- 
ability ratio test [Wald, 15], [Epstein and Sobel, for testing simple hypo- 
500 hours). The decision rule applied after the rth failure if: 


1 


1 


1 


R(r) 


Figure depicts the O.C. curves for this procedure when the failure times 
follow the Weibull distribution. These curves were calculated using method 
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due Wald [15]; namely, that the probability acceptance for given mean 


(10) 


2=0 


Equation (10) derived Appendix and the constants are tabulated 
(47). The procedure for calculating L,(m) choose arbitrary solve 
for then find and finally substitute (10). check the accuracy this 
approximation, simulation study for the sequential procedure was carried 


out computer. The sequential tests were truncated 112 observations. 
These results are summarized Table 


m= 


(11) 


DISCUSSION 


None the four life testing procedures studied this paper robust with 
respect Weibull alternatives. particular the censored life test and the 
truncated non-replacement test are strikingly non-robust. obvious from 
the graphs the O.C. curves that lots having low mean failure times have 
high probability acceptance when the failure times follow Weibull distri- 
bution with shape parameter This tendency increased increases. 
Both these life testing plans depend the distribution function the 
order statistics which turn sensitive the original distribution. the 
other hand, the fixed sample size plan and the sequential procedure make use 
averages. Hence the central limit theorem suggests that these procedures 
would not sensitive departures from the original distribution. This 
borne out our calculations. 

have tried show that dogmatic use life testing procedures without 
careful verification the assumption that failure times follow the exponential 
distribution may result high probability accepting equip- 
ment. 

“Quality” has been defined the mean-time-to-failure mean-time-between- 
failures which simply the first moment the life distribution. When the 
failure times follow the exponential distribution, the mean time satisfactory 
criterion for defining quality. However, may highly artificial and often 
misleading for other failure distributions. more meaningful and practical 
approach would specify point the reliability curve. many instances, 
the engineer has mind percentile, which transformed into mean failure 
time assuming the exponential distribution. For example, one could specify 
that least 90% the items should (on the average) survive 105 hours, 
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0.C. CURVES FOR SEQUENTIAL RATIO PLAN 
BASED EXPONENTIAL DISTRIBUTION WHEN PARENT 
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0.90. When the reliability function exponential, this require- 
ment the same stating that the mean failure time least 1000 hours. 
However, the reliability function Weibull, the requirement the mean- 
failure-time will much different. Note that the mean the Weibull reliability 
function 


Hence can written explicitly function i.e. 


Thus the for which R(105) .90 


The corresponding values the mean failure time for 3/2, and are 
425, 287, and 199 hours respectively. Obviously low mean failure time does 
not indicate poor quality this instance these values all insure that least 
90% the items (on the average) will survive 105 

Alternatively one might specify different point the reliability curve. 
Suppose one specified that least half the items should survive 693 hours, 
R(693) 0.50. the reliability function exponential, this will satisfied 
for mean failure time 1000 hours before. However, when the reliability 
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function Weibull, the minimum mean failure time 


Values for this case are 800, 738, and 700 hours corresponding 
3/2, and respectively. Thus when different points the reliability 
curve are specified, different requirements are placed the mean failure time. 
The specification quality percentile not new. the practice 
for ball bearings where the “load actually that life for which 90% (on 
the average) ball bearings will survive; c.f. Lieblein and Zelen [13]. Adoption 
percentile for specifying quality should also done for components and 
parts. Instead specifying mean life one should perhaps speak “median 
(the life which half the items survive). course different applications 
may require the specification different percentiles. future paper hope 
develop further the idea setting specifications terms percentiles. 


ANALYTICAL METHODS FoR STUDYING 


The general problem studying the robustness life testing procedures 
based the exponential distribution involves the investigation the operating 
characteristics when the underlying distribution (or reliability function) 
other than exponential. One may study the O.C. curve when the failure times 
follow specified distribution; without choosing particular distributions 
possible study the robustness life testing procedures specifying the 
values skewness and excess 

The primary aim our robustness studies gather qualitative information 
the behavior certain life testing procedures when the distribution 
failure times not exponential. have found convenient develop 
general life distribution which can used both when some the lower order 
moments differ from that the exponential and also when specific alternative 
distributions are specified for the failure times. this latter situation, the 
parameters the general life distribution are chosen approximate the specified 
distribution. This section develops the properties such general life distri- 
bution which lends itself easy computation. 


4.1 Laguerre Polynomials 


Our general life distribution makes extensive use generalized Laguerre 
denoted For the convenience the reader, here summarize 
some useful properties Laguerre polynomials, Erdélyi al. [9]. 


referee has called our attention unpublished work Gupta and Sobel [10] who 
also make use Laguerre polynomials life testing context. 
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4.2 General Life Distribution 
Let non-negative random variable with probability density function 


where positive integer and and are suitably chosen constants with the 
provision that The reliability function can written 


which are respectively the p.d.f. and reliability function the exponential 
distribution. 

there exists another non-negative random variable having f(x), 
suitable approximation for can found choosing such that 


Assuming the existence moments order for f(x), the definition 
(19) results the moments p(x) order being equal those The 
parameter chosen such that 


This insures that the order contact for both distributions near the origin 
the same. 


4.3 Momenis and the Characteristic Function 
Using equation (15) the characteristic function 


s=0 


Since can write 


r=at+e 


al 
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the characteristic function can displayed 


Thus the moments about the origin are 
min (r,k) 


s=0 


particular the first four moments are: 


(23) 


Hence denotes the rth moment about the origin known random 
variable one could approximate the distribution letting the moments 


a= 
where 
, 
For the generalized p.d.f. p(x), sometimes convenient set and 
consider the distribution the random variable 


™ 
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where 


with characteristic function 


The constants can found from (24) with 


—(sta+l1) 


4.4 Distribution Sum 


p(x). Then the characteristic function the sum 


s=0 


independent random variables having the 


which after expansion and some simplification can written 


s=0 


The p.d.f. say found using the inversion formula for character- 
istic functions, i.e. 


s=0 


Since the characteristic function associated with the gamma distribution with 


Differentiating the above expression times with respect results 


| 
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Letting na) and (30) (29) gives 
kn 
N-1 
order find the reliability function observe that 


T(s) 


Hence the reliability function 


Now and from Szego [14, 175, eq. 7.68], 


therefore, 


which indicates that the leading terms (32) may provide good approxi- 
mation 

When the random variable under consideration Xm/(1 a), the 
defined (28) with this case, 


odd. 


Hence for small 


odd 
and 


—u,N 2q+1 


4.5 Sequential Tests 


Epstein and Sobel [8] have developed several life pro- 
cedures based the exponential distribution. Their development uses Wald’s 
work [15] virtually without modification. this section develop the necessary 


(31) 
in 
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tools for studying the behavior one these procedures when the underlying 
probability density function the general life p.d.f. given (17). 


exponential distribution 


Then the sequential ratio procedure for testing the simple hypothesis 


s=1 


where 


(35) 


Let L(m) the probability acceptance when the mean Then Wald 
[15] has shown that good approximation the O.C. curve given 


(36) 
where the non-zero solution 
(37) 


and indicates taking the expectation when the mean 


Similarly the average (expected) sample number (ASN) reach decision 
can calculated approximately 


Both (36) and (38) are only valid when 
Our objective this section evaluate the O.C. curve and ASN when 
the sequential procedure (34) used but the underlying failure times 


not exponential but given (17). 
Now 
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The above integral exists provided 
Therefore using (37) 


(39) and finds the corresponding value L(m) and can then 


calculated. 
For the case where and 


and thus 


The above expression exists only when Kmh/(1 
order calculate L(m) and E,,(n) let 


Kmh Kmh 


Then 


and (40) can written 
{(w/(i-w)] k 


s=0 


Taking logarithms and re-arranging terms results 


Thus one need only choose arbitrary solve for and using 


[(1 w)] find the corresponding values L(m) and E,,(n). 


(40) 


(41) 


(42) 


and 
hk 
E Zz 
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>. 


ROBUSTNESS LIFE TESTING PROCEDURES 


One can then apply the results Wald [15, 176] get 


1 


4.6 Application the Weibull Distribution 


This section will apply the various formulas developed previously approxi- 
mate the distribution sum independent random variables drawn from 
the Weibull distribution with 


p-1 


The moments about the origin for the Weibull distribution are easily shown 


Since the mean 


the moments can ~xpressed 


the order contact zero for the generalized p.d.f. p(x) given (17) 
the same for f(y), then must choose Since the moments 
function can approximated (33) where can found using 
expressions like (24) with 


p=3/2 


—0.12340 —0.15117 —0.15093 
—0.06925 —0.09014 —0.08475 (47) 
—0.01879 —0.02122 —0.01211 


4 

as 
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The corresponding values used (33) are given (28). The first 
five values are 


head a, = 0 
(48) 
a, = n . 
This results the numerical values 
p=3/2 

—3.23927 —12.67812 
—2.12089 —5.04788 —11.86468 (49) 


The constants tabulated (48) and (49) were used calculate the O.C. 
curves for the fixed sample size and sequential procedures described section 


THE EXPONENTIAL ASSUMPTION 


Epstein recent paper [4] enumerates several procedures for testing 
the validity the assumption that observations come from exponential 
distribution. connection with our robustness study, brief investigation was 
undertaken see how powerful these procedures are distinguishing between 
the exponential and Weibull distributions. The two tests referred Epstein 
“Test and were examined. Test conditional the total 
time test; Test was chosen because Bartholomew [2] compared the power 
three competing tests and found Test the asymptotically most powerful 
the three against Weibull alternatives. 

Suppose are interested testing the hypothesis that the failure times 
replacement censored situation where the life test starts with items and ends 
soon the first failures occur n). Then the total time test 
and including the failure 
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the interval [0, for fixed Hence 


Z= i=1 


approximate standard normal deviate. Epstein (Test suggests that 
reject level |Z| where the 100(1 a/2) percentage point the 
standard normal distribution. 
Epstein’s Test uses the statistic 


where the total time test the interval This statistic 
Hence the test procedure reject level x2(r 1). 

order determine the operating characteristics these tests, the 
proportion times the tests would distinguish between the exponential and 
Weibull distributions, empirical sampling study was run electronic 
computer. .05 level significance was chosen. Random samples were 
drawn from each the Weibull distributions with shape parameter 3/2, 
and and also from the exponential distribution. All distributions had the first 
moment equal unity. Both testing procedures were simulated samples 
from these distributions; the results this simulation are tabulated below. 


Proportion times exponential assumption rejected .05 level significance 


3/2 

1.000 


Starred values are based 600 samples simulations. All other values are based 
300 samples. 


obvious for small sample sizes that Test not powerful enough 
distinguish between the two distributions. Interestingly Test which con- 
ditional upon the total time test, appears more powerful than Test 
but even effective only when the shape parameter becomes large. 


i 
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Probability Acceptance for Sample Size Plan 


Empirical Sampling Results* Analytical Results 
MTBF 
TABLE 
Probability Acceptance for Censored Plan 
Empirical Sampling Results* 
MTBF 
1000 1.000 1.000 1.000 
750 1.000 1.000 
600 .977 1.000 
TABLE 
Probability Acceptance for Sequential Plan 
where R(t) (Truncated 112 trials) 
Empirical Sampling Results* 
MTBF 
500 .097 .000 


Each entry based 1500 simulated life tests. 
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Application Balanced Incomplete 
Block Design 


California Research Corporation, Richmond, California 
and the University California, Berkeley 


The analysis balanced incomplete block experiments discussed most 
the standard textbooks experimental design. These discussions are usually con- 
fined qualitative treatments; being customary obtain adjusted sum 
squares for treatments and give procedures for determining the significance 
the observed difference between two treatment totals. 

This paper describes balanced incomplete block experiment which the nine 
treatments were quantitative rather than qualitative, being actually two additives 
each four levels and third one level. The unusual feature the analysis 
found Section where the adjusted sum squares for treatments subdivided 
into individual degrees freedom, each which meaningful and specific this 
and with which obtain from the data response curves for the two factors 
which were used four levels each. 


INTRODUCTION 


this dishwashing test solutions the treatments (detergent formulations) 
are made up, and plates soiled with standard soil are washed one time 
until they are clean. The testing procedure stipulates that three basins shall 
used (three treatments tested the same time). The three operators wash 
the same speed during the test, and the reported the number plates 
washed before the foam disappears. consider each set three such con- 
current trials block, clear that variation between the blocks can 
expected, due such factors changes the temperature the washing 
and the common washing rate from block block. 

are specifically concerned with balanced incomplete block experiment 
with nine treatments blocks three plots each; this design also balanced 
lattice. 

Three basic detergents were used. Two them were tested with and 
parts additive. The third was standard detergent, which was expected 
give higher yield than the other eight treatments. 

shall denote the treatments letters follows: for base 
Detergent with parts additive, respectively, and for the control 
treatment. The design used was (the observed yields are given parentheses): 
The blocks were actually run random order, and the allocation treat- 
ments basins within blocks was random, that the experiment was not 
divisible into replications for the purposes analysis. 
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THe INTRABLOCK ANALYSIS 


give this section summary the usual intrablock analysis. For 
details the reader referred such standard works Davies [1], Scheffé [2]. 

The model assumes that the yield for the treatment the jth block 
given 


+e; (2.1) 


where the grand mean, the treatment effect, the jth block effect, 
and the intrablock error with The errors are in- 
dependently normally distributed with zero mean and variance There are 
experimental units each block and total treatments. Each treatment 
repeated times and each pair treatments occurs the same block times, 

units with the ith treatment)—(total all blocks containing the ith treatment). 
adjusted sum squares between treatments For this experiment 
The mean square for error 0.82 (16 


RESPONSES DETERGENTS THE ADDITIVE 


wish now further than the analysis usually given the standard 
texts for qualitative variables and consider the nature the responses 
the two base detergents the additive. The adjusted sum squares between 
treatments will subdivided into eight components, each having one degree 
freedom corresponding contrast between treatments. 

rewrite the model letting the (2.1) expressed as: 


represents the expected value the average yield for the hth base deter- 
gent over the four levels the additive. 
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BALANCED INCOMPLETE BLOCK DESIGN 
For the control write and have 


choose eight orthogonal contrasts between the each corresponding 
one the eight degrees freedom between treatments.’ The contrasts are 
given Table together with their expectations, variances, and observed 


Contrasts 


Obs. 
Contrast Exp. Value Variance Value 


Linear 

Quadratic 

Cubic 

Linear 

Component II + Qr Qe 180 be 5400? 182 
Quadratic 

Cubic 

Component II + 3Qr = 3Q¢ + Quy 180 ds 5400? -4 
Control 


values. They correspond linear, quadratic, and cubic components for the 
responses base Detergents and II, comparison between and II, and 
comparison between the control and the average and II. 

may easily show simple substitution the appropriate vaiues 
(3.1) that 


The details are similar for the other contrasts. 

The expectation the last contrast but since 


Since all the have the same variance and all pairs the same covariance 
orthogonal contrasts the are orthogonal contrasts the observations, and lead 
subdivision the treatment sum squares. 


| 

Peasy 


The sum squares for contrast obtained squaring the value the 
contrast and dividing the coefficient the expression for the variance 
the contrast. 
This leads the analysis variance table. 


Analysis Variance 


Quadratic 12.68 12.68 15.46** 
Cubic 0.22 0.22 0.27 
Linear 61.34 61.34 74.80** 
Quadratic 0.15 0.15 0.18 
0.03 0.03 0.04 
Control 345.04 345.04 420.78** 
Treatments (adj) 1086.81 
Blocks (unadj) 412.75 
Intrablock Error 13.19 0.82 
Total 1512.75 


clear from this table that the response base Detergent the additive 
may represented quadratic curve while the response Base linear. 
The linear relationship for base Detergent estimated 


similar calculation the quadratic estimation function for base Detergent 
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TECHNOMETRICS 1961 


Multi-Component Systems and Structures 


and Their Reliability 


University Washington 


Boeing Scientific Research Laboratories 


number recent publications have dealt with problems analyzing the 
performance multi-component systems and evaluating their reliability. For 
example, comprehensive theory two-terminal networks was presented [1] 
Moore and Shannon who, among other results, have developed methods for obtaining 
highly reliable systems using components low reliability; some their procedures 
are credited earlier work von Neumann [2]. Several the concepts and results 
the present paper are generalizations the corresponding concepts and results 
the Moore-Shannon paper. discussion complex systems interpreted Boolean 
functions may found the paper [3] Mine. 

The present study deals with general classes systems which contain two-terminal 
networks and most other kinds systems considered previously special cases, and 
investigates their combinatorial properties and their reliability. These classes consist, 
with several variants, systems such that the more components that perform the 
greater the probability that the system performs. For such systems shown that, 
each component has reliability and the reliability the system denoted 
then under mild additional assumptions S-shaped function, i.e., its 
graph has the shape indicated Fig. 3.2.4.1. Some the consequences are these: 
there exists critical value such that above that value the reliability the system 
greater than the reliability single component and below that value smaller; 
for small the system has reliability comparable that series system, and 
for large that parallel system; repeatedly iterating the system, i.e., 
using replicas the system instead single components, one obtains systems with 
reliability arbitrarily close one starts with component reliability above the 
critical value, but with reliability arbitrarily close one starts below that critical 
value. 


INTRODUCTION 


very complex device constructed, consisting large number 
components, often impossible quite sure that will perform the 
task for which was intended. Failures components due causes which 
are hard anticipate and practically impossible prevent may lead failure 
the entire structure. such situations, the best one may strive for designing 
the structure attain high probability that will perform its task. has 
become customary refer the probability that structure will perform the 
task for which was designed the that structure. simplifying 
(and possibly not quite realistic) assumption implied this definition 
reliability: assumed that structure can only either perform fail. 
emphasize this assumption, shall sometimes use the term dichotomic reliability 


14 


for the probability that structure will perform its task. possible intro- 
duce and study more general concept reliability which accounts also for the 
possibility partial performance. The present study, however, will limited 
dichotomic reliability. 

similar situation arises when, instead complex structure, one con- 
siders single mass-produced components. There again one can hardly expect 
sure that all components will perform and can only aim high prob- 
ability that component, when called upon, will perform. before, the prob- 
ability that component will perform the function for which intended will 
called the (dichotomic) reliability that component. 

1.3. pointed out that the time element does not explicitly enter into 
our definition dichotomic reliability. may enter what meant 
certain manner for least 400 hours, and fail breaks down before that 
time. But there also are practical situations where structure considered 
performing when working order for instantaneous use, and not necessarily 
for any length time. Our dichotomic reliability includes the time-dependent 
reliability special case. 

One the main purposes mathematical theory reliability 
develop means which one can evaluate the reliability structure when 
the reliabilities its components are known. The present study will con- 
cerned with this kind mathematical development. will necessary for 
this purpose rephrase our intuitive concepts structure, component, re- 
liability, etc. more formal language, restate carefully our assumptions, 
and introduce appropriate mathematical apparatus. 


2.1. order study the relationships between the reliabilities the com- 
ponents structure and the reliability that structure, one has know how 
performance failure the various components affects performance failure 
the structure. For this purpose shall describe the state any device, 
single component complex structure, writing when performs and 
when fails. structure consists components will called structure 
order The state all components such structure will described 
vector with coordinates 


where means “ith component performs” and means com- 
ponent All possible states the n-tuple are given the vertices 
n-dimensional cube. Some these vectors will make our structure perform, 
and others will make fail, that the state the structure may written 
function call which assumes the value unity for those vectors which 
make the structure perform and zero otherwise. The function will called 
the structure function or, short, the structure. 

analogy with terms used the theory circuits, any vector for which 
will called path for the structure and any vector for which 
cut for that structure. 
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The number components performing when the state all components 


t=1 
which will called the size 
The following abbreviations and definitions will useful: 


2.2. Examples Structures 
2.2.1. Parallel Components 


that fails and only all components fail. This structure described 


2.2.2. Components Series 
structure which performs and only all its components perform said 
contain its components series. described 


and the only path for 


2.2.3. Switching Circuits 
Consider the following circuit diagrams: 


(i). (ii). 


Such diagrams these are often used define what have called the 
structure function. realizing that the circuit Fig. (i) constructed 
connecting series and/or parallel subcircuits themselves series and/or parallel 
can write down the structure function using the definitions the preceding 
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paragraph. Thus the structure function for the module consisting 


7 

1 Il (1 2) |: 

continuing this fashion have for the entire circuit 


i=1 


— tea 


exhibit the structure function for the circuit Fig. (ii) 


not our purpose discuss general the method representation 
switching circuits but merely present some examples these circuits which 
are structures the type are considering. 

call the reader’s attention the fact that circuit the type Fig. (i) 
sometimes called two-terminal network. also point out that the circuit 
Fig. (ii) contains the fourth component two different locations. This can 
happen for example with contacts identified wiring with components which 
receive power from the same source again with circuit breakers connected 
rod. 


RA 


(2.2.3.2) 


Let 


components perform, and fails otherwise. shall call out struc- 
ture. Clearly all such that s(x) are paths, all others cuts. For the 
out structure reduces the structure with parallel components, and for 
the structure with components series. 

remark that out structures are frequently encountered practice, 
viz., could happen that three out four airplane engines operational during 
certain flight stage would not disastrous but the loss one more engine 
would be. 


2.3. The Dual Structure 


given structure define the structure 


and call the structure dual One verifies immediately that vector 
example consider the out structure 2.2.3. The dual struc- 
ture 
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particular for find that the structure dual that with parallel 
components the series structure, and for obtain the converse state- 
ment. 

may happen that certain structures are self dual, For example 
Fig. (ii) 2.2.3 the structure self dual. This can checked easily 
making the appropriate changes (2.2.3.2). 


and Cut-numbers 


given structure may have paths and cuts sizes ranging from 
define the path-numbers for given structure for nas 


and the cut-numbers for for 0,1, nas 

Let the set all vectors size 

(2.4.3) {x: a(x) j}. 

Then clearly 


xe 8; 


and since contains exactly vectors and each them either path 


cut have 
Setting 


* 


number cuts for size 

obtain 

(2.4.6) 

2.5. Length and Width Structure 

analogy with terms used the theory circuits define for structure 
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Intuitively speaking, the smallest number components such that, 
these components perform, the structure performs even all other com- 
ponents fail. Similarly the smallest number components such that 
they fail the structure fails, even all remaining components perform. 


According (2.5.1) follows that 
for 
hence (2.4.5), 


for 


But also according (2.5.1) 


2.6. Combination Structures 


now have always considered one structure given order shall 
now consider structures different orders and particular define operation 
which structures higher order can obtained from structures lower 
order. 

shall say that the structure order linear combination or, 
short, combination the structures and order when the identity holds 


Clearly and are structures order then the right side (2.6.1) 
represented combination two structures order i.e., can written 
the form (2.6.1), since one always has the well-known identity 


This representation structure combination structures lower order 
can carried until one reaches structures order one. then have the 
well-known representation 


where the sum extended over vectors order 
and Coherent Structures 


Most structures occuring practice are designed that structure per- 
forms for state its components then performs for every state 
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some components which have value (do not perform) are 
given value (are made perform). This leads the following definitions. 


structure coherent satisfies (2.7.1.1) and 


Thus coherent structure semi-coherent, with the additional property 
that fails when all its components fail and performs when all components 
perform. 

For given order there are only two structures which are semi-coherent 
but not coherent: the structure ¢(x) which fails for every state its com- 
ponents, and the structure ¢(x) which performs for every state its com- 
ponents. see this one only has note that for every hence 
(2.7.1.1) 


semi-coherent (coherent) then semi-coherent (coherent). 


linear combination functions order the form (2.6.1) with and 
semi-coherent and such that u(x) for all coherent and 
are semi-coherent and u(x) for every coherent then either 


with and semi-coherent, then 


and 
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preceding theorem suggests the following constructive procedure 
for obtaining all structures. 
follows. 
consists the three structures order one: 
B2(2,) = 1 for = 0, b 
concrete terms, these are one-component structures such that never 
performs (circuit with one contact, grounded), performs and only the 
component performs (circuit with one operative contact), always performs 
(circuit with one contact, shorted). 
define the class all structures order the form 
Having defined define recursively the class all structures 
exactly the class all semi-coherent structures order 
Inequality for Path-numbers 
numbers. Then 
equivalently, 
(2.7.4.2) 
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Each set contains different y’s. Since for each there are 
different x’s such that the collection all elements all sets 


and since 


obtain (2.7.4.1). 
2.7.5. Inequality (2.7.4.1) points the fact that the requirement structure 
being semi-coherent imposes considerable restrictions the path-numbers 
Several observations are worth making this connection. 
2.7.5.1. Inequality (2.7.4.1) necessary but not sufficient for structure 
being semi-coherent, shown the following example. The structure 


order 

has the paths 


size none 

size (1, 1), 


hence its path-numbers are 
Ao = 0, A, = 2, A; = 2, A; = 1 


and (2.7.4.1) fulfilled. But not semi-coherent since e.g. (1, 1,0) (0, 


then (") for Both statements follow from (2.7.4.2). 


(2.7.5.3) 
2.7.6. Reduction Coherent Structures 


| ia he 


omitting components which turn out inessential for its performance. 
this would helpful have criteria which one can tell whether given 
structure has such inessential components. criterion this kind will given 
2.7.6.4, but before can stated need the following definitions. 


Definitions 


vector minimal path for the coherent structure when ¢(z) but 
for every have ¢(x) The ith component inessential dummy 
component when 


essential component. 
structure called irreducible all its components are essential. 


2.7.6.3. Remarks 


One verifies easily that path for coherent structure then there 
least one minimal path such that 
structure order has dummy ith component, then have identically 


that the ith component can omitted and the resulting structure with 
only components equivalent with the original structure 
Let now consider structure order and assume that all its 
minimal paths are Each these minimal paths vector 


with coordinates consider the vector defined 


The meaning this vector this: then the coordinate assumes the 
value for least one the minimal paths, that is, the component 
required perform for least one minimal path; then the ith co- 
ordinate does not perform for any the minimal paths. particular, 
then every one the components the structure must perform 
for some minimal path. 


Those coordinates the vector (2.7.6.3) which have the value corre- 
spond essential components, and those which have the value dummy 
components. particular, necessary and sufficient condition for coherent 

Proof: Without loss generality may consider the coordinate 
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MULTI-COMPONENT SYSTEMS AND STRUCTURES 


component essential. then the last component zero for all minimal 
paths. Consider any vector (x, path cut for shall show 
that the 1)st component dummy. 

(x, path then there exists minimal path, say again (z, 0), and 

(x, cut implies (x, cut also. For were path the preceding argu- 
ment applied would yield ¢(x, which contradiction (x, being 


true. Now take case two. Then (x, cut but and the 
proof complete. 


Remark 


Theorem 2.7.6.4 suggests the following procedure for simplifying coherent 
structure first one lists all minimal paths for then one prepares list all 
those components which must perform (have value least one minimal 
path. this list contains all components then this structure irreducible. 
component does not occur this list then that component inessential 
and can omitted. course the criterion Theorem 2.7.6.4 may not 
the most practical direct way finding inessential components. The designer 


should usually able find inessential components direct application 
engineering principles. 


Representation Coherent Structures 


state simple and rather useful representation theorem, define for 
any pair vectors and the same order the structure function 


Clearly, for given the coherent structure which has the minimal 
path and other minimal path. Similarly, for given the co- 
herent structure with the unique minimal cut vector minimal cut 
for the coherent structure when ¢(y) but for every 
have 1.) 


and the minimal cuts --- then represented either the 
expressions 


i=l 


Proof: have ¢(x) and only for some hence and only 
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for some and this also necessary and sufficient for the right 
side (2.7.7.1.1) having the value The proof (2.7.7.1.2) similar. 


2.7.7.2. Remarks 
The identities 2.7.7.1, together with the obvious identity 


(i:28=1) 
make possible write down immediately the structure function structure 
for which either the minimal paths the minimal cuts are given. may also 
worthwhile note similarity between the identities 2.7.7.1 and those 
2.2.1 and 2.2.2, and observe that the structure behaves consisted 
arranged series. 


Let take the structure defined Fig. (ii) (2.2.3) for which represen- 


which may compared with that given earlier. However from this represen- 
tation not easy see that the structure self dual. 


2.8. Composition Structures 


practical designing structures often happens that the design pre- 
pared stages, that first structure order conceived, and then for 
some all its components one substitutes other multi-component structures. 
This for example the case when planning electric circuits self-contained 
packages components called are used circuit. 
The formal description this process superimposing structures introduced 
the following definition. 

Then the structure order not exceeding defined 


The blocks components may overlap. particular, all them 
ing structure 


order 
Both the switching circuits defined may obtained the 
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composition simpler structures make the more complex ones indicated. 
fact this method that exhibited the structure function the circuit 
diagram given. 


2.8.2. Combination structures, defined 2.6, special case com- 
position, since (2.6.1) can obtained the composition into the 
structure defined 


where have the same block components and the component 
One can therefore, beginning with the structure order given (2.8.2.1) 
which coherent, and using semi-coherent and increasing orders, obtain 
exactly the same family structures which can obtained beginning with 


FUNCTION 


indicated section one the main aims the mathematical 
theory reliability evaluate the probability that given structure will 
perform. Having previously discussed formal properties structures, shall 
now assume that components given structure may perform fail 
random manner and derive various statements about the reliability the 
structure. 


3.1.2. Let structure order assume that its components are 
independent random variables 


each with the same probability distribution 
that 


also random variable capable the values and now define the 
reliability function the structure 


and devote the remainder this paper the study reliability functions. 
Properties Reliability Functions 

(3.1.2.1), (3.1.2.2) and (2.4.1) follows immediately 


4 
Ag 


order then taking mathematical expectations both sides (2.6.1) 


now consider structures obtained composition the following 
let (Y, independent random variables, all with the same prob- 
ability distribution 


has the reliability 

(3.2.3) 


reliability functions most practical structures have the following 
plausible qualitative properties: 


h(p) pin some neighborhood 
h(p) some neighborhood and there exactly one root the 
equation h(p) the open interval (0, 1). 


Necessary and sufficient conditions for have with property were 
stated 3.2.1. shall also obtain conditions structure which are neces- 
sary and sufficient order that have property b), more precisely defined 
property Before doing this, however, some intuitive comments these 
properties may order. 

Property tells that the reliability the structure increases the com- 
ponent reliability increases, and encountered for practically all structures. 

When has property will say that S-shaped, since its graph has 
then the general form indicated Fig. 3.2.4.1. formal theory S-shaped 
functions will presented later, but already this qualitative discussion 
may indicate some consequences being S-shaped. 

h(p) and the structure less reliable than any single component long 
and similarly h(p) and the structure more reliable than any single 

Furthermore, let structure with S-shaped reliability function 
and let the sequence compositions defined the sequence 
structures 
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function. 
(reliability function for out structure) 


According 3.2.3 the corresponding reliability functions are 
hi(p) 


Fig. 3.2.4.2 that 


that iterated compositions one can obtain structures with reliabilities 


h(p) 
ot 


2—Iterated composition reliability function for out structure. 


easily seen that the structure described 2.2.3 has the reliability function 


t=k 
(3.2.5.2) 


may read off from Table 3.2.5. This table was computed from [4] linear 
interpolation, except for the case for which (3.2.5.2) was solved directly 
and the solution rounded off three places. 

For large values and np, both not small, the central limit 
theorem makes possible replace (3.2.5.1) the approximate equality 


where N(u) the area under the standard normal probability curve from 


3.3.1. Definitions 

shall say that the function belongs class when satisfies 
the following conditions 
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(ii) the function defined 


say that belongs class when satisfies (i) and 

3.3.1.3. say that belongs class when belongs and satisfies 
the condition 


From the definition follows 


(3.3.2.1) 


TABLE 3.2.5 


=l1- Pn+i-k,n 


a 


function assumes every value most once, follows that consists 

The functions class are therefore S-shaped the sense 3.2.4. 

therefore either identically identically maps the closed interval 
onto the closed interval 1]. This need not one-to-one, 
shown the example 


f(p) 


for 
4(p 1/2)? for 1/2<p<1. 


Furthermore, let either 


Then the function defined 
Proof: One directly that satisfies (i) and (iii). prove (ii’), that 

From (3.3.3.1) follows 


that (3.3.3.2) holds either case. 

3.3.4. Theorem 


Proof: Properties (i) and (iii) for are obvious, and (ii’) follows from 


3.4. Mean Path and Mean Cut 
3.4.1. Let and ¢(X) have the same meaning 
3.1.2, and let 
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the size the random vector i.e., the number components which per- 
form. Then random variable with the binomial distribution, random 
but and are dependent random variables. natural consider 
the conditional expectations 


and call L(p) the mean path, W(p) the mean cut for the structure 


order that the reliability function structure order strictly 


This condition equivalent with 
(3.4.2.2) cov (S, 


Proof: shall prove somewhat more specifically that for any fixed 
each the conditions (3.4.2.1), (3.4.2.2) necessary and sufficient 

Writing short for have from (3.2.1) 


which shows that (3.4.2.2) equivalent with h’(p) 


Since 
and 


ings 
| 


obtain 


cov 
that (3.4.2.1) and (3.4.2.2) are equivalent. 
3.4.3. Theorem 


Let structure order and its reliability function. order that 
strictly increasing necessary and sufficient that 


(3.4.2.4) 


‘and this condition equivalent with 


lent with inequality (3.3.3.2). From (3.4.2.3) follows 


and since 
inequality (3.3.3.2) equivalent with 
From (3.4.2.4) follows 


which shows that (3.4.3.1) and (3.4.3.2) are equivalent. 
3.5. Structures Coherent Probability 
3.4.1. shall say that structure order coherent probability when 


for 


structure coherent probability and only its path-numbers satisfy 
the inequalities (2.7.4.2) and (2.7.4.1), and 
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have 


= 4,/(*), k=0,1,-++ ,n 
for any structure, and our theorem follows immediately. 


3.5.3. Corollary 


This follows from 3.5.2 and 2.7.4. The converse statement not true, 
shown the example 2.7.5.1. The structure order described there satis- 
fies (2.7.4.2) hence coherent probability, but not even semi-coherent. 


Theorem 


coherent probability then its reliability function non-decreasing 


and 3.5.2 and (2.7.4.1) obtain h’(p) 
3.6. Reliability Functions Semi-Coherent and Coherent Structures 


3.6.1. 


Theorem 


hs ev. 

Proof: use induction the order first consider The three 
possible structures order listed 2.7.3 have the reliability func- 
tions respectively. now assume our statement true for order 
have 


(3.6.1.1) 


with and semi-coherent order and A(x) u(x) for all From (3.2.2) 


have 


true the assumption induction. \(x) u(x) for some value then 


coherent structure then either 


This follows immediately from 3.6.1 observing that for coherent h(0) 
and h(1) hence neither identically nor identically 


i q 
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3.6.3. Theorem 


and 


(3.6.3.1) 


For the function strictly increasing and assumes the value 
3.6.4. Inequalities for h(p) Terms Length and Width 

Let and denote the length and the width structure defined 


lim 


This immediately yields the inequalities 


which show that for the function h(p) tends not faster than that 
is, not faster than the case components series; and tends 
not faster than that is, not faster than the case parallel 
components. 

Inequalities (3.6.4.1) hold without any assumptions coherent 
probability, have inequalities (2.7.4.2) from which one obtains 
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From these inequalities and (3.6.4.1) follow the bounds for h(p) 


3.6.5. Qualitative Remarks 
3.2.4 described some properties reliability functions which appeared 
desirable for practical structures. The preceding theorems tell what kind 
structures have these properties: coherent then has properties and 
3.2.4 (according 3.6.2). Furthermore, coherent then the conditions 
tion class hence S-shaped and lending itself the process iterated 
compositions. 
The class coherent structures very large. contains among others the 
two-terminal networks whose reliability has been studied Moore and Shannon 
their fundamental paper [1] and all out structures. 


and 
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Asymptotic Distribution for Occupancy 
Problem with Statistical Applications 


Knolls Atomic Power Laboratory, 


Given population items which are defective. Let the population 
divided random into lots equal size (i.e. ks). This paper derives the 
asymptotic distribution the number lots containing more defectives 
contains more defectives, and one interested the proportion lots 
grand lot which are defective. Then the basis random sample items one can 
obtain confidence limits various functions the distribution the number 
defective lots. This allows high power against excessive number defective lots 
average sense (as variables sampling) even for rather small samples. If, fact, 
allocation items lots random but occurs with local positive contagion 
appears that the random sample will tend overstate the proportion defective lots. 


INTRODUCTION 


Sampling often carried out order estimate put confidence limits 
probability. manufactured product that probability often simply the 
percent defective items produced, defective items occur randonly. how- 
ever, the product made, purchased used groups such way that 
defectives tend group together, the percent number lots probability 
lot containing more defectives may the quantities interest. 
defectives occur randomly, the probability distribution the number lots 
containing more defectives will function the probability defective. 

Thus, for example, low percentage silicon inclusions per unit volume 
steel castings sometimes tolerated the interest economy and for lack 
100% foolproof detection. frequency inclusions that safe for small, easily 
replaced die castings may quite unacceptable for huge, expensive turbine- 
generator rotors because the high percentage rotors containing least 
one inclusion. Similarly, two manufacturing processes, each producing the 
same proportion defective items, one may judged acceptable simply 
because statistical control whereas the second may producing 
abnormally high percentage lots each containing substantial number 
defectives. The latter process virtue the non-random occurrence defect- 
ives should correctible and may therefore unacceptable is. 

the main interest were the probability that more lots size from 
among such lots, contained more defective items, might quite uneco- 
nomical difficult select sample lots and ascertain for each sampled lot the 
number defective items. Either two alternatives may available: (1) 
Select subsample individual items from each sample lot (2) select 
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sample individual items from among all items and group the remaining items 
random into lots, each size consider the second alternative. 

This paper gives the exact and asymptotic distributions the number 
sublots, each size containing defectives from among items 
containing defectives, where the sampling items and formation lots are 
(2) above. Since the cumulative probability function 
monotone decreasing function the usual upper confidence limit 
leads lower confidence limit the lots cannot composed 
random and there positive contagion, the probabilities obtained assuming 
random composition lots will, under plausible assumptions the effect 
the contagion, provide upper bounds the true probabilities. For example, 
fuel plates for reactors are often made rolling fuel ingots flat and cutting them 
into sections, each which completely covered protective cladding. 
If, the cladding operation, the reduction sections slight, any fraction 
plate core volume corresponding particular square inch plate surface 
that known contain high fuel content due over-nominal thickness 
apt contiguous square inches also having high fuel content. The propor- 
tion over-nominal thickness inches rolled fuel ingots will then lead 
upper bound the number plates, least the number sections, with 
one more square inch with over-nominal uranium loading. Thus bound 
the number defective sections can obtained without sampling sections; 
will, course, satisfactory bound only the fuel ingots are sufficiently 
uniform thickness. The distribution also useful guide whether 
process good enough allow random assembly, opposed selective 
assembly, its output into lots. 


SUMMARY 


usual symbol for the largest integer contained a). Define 
the observed number groups containing more defectives each. 


0 
1 


then asymptotically 

and 
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Derivation this result given section Applications some practical 
problems are discussed section Some comments and computations relating 
the usefulness the asymptotic results are given section 


RESULT 


For simplicity, suppose kgs. Clearly this permissible for large. 
Consider population items kgs which are defective (ks and 
integral). Suppose allocate the items groups, each size 
random. Suppose define defective group one which there are least 
defective items s). Now ask for the probability distribution 
the number defective groups; use denote both the random variable 
and some arbitrary one the values the random variable can assume. 


obvious that 
also obvious that 


Suppose identify the groups Ist, 2nd, 3rd, kth and 
denote the number defectives the ith group 


get the probability that groups are defective, least out 
the items group being defective defines defective group, writing 
the probability that the groups defective groups and the last 


non-defective groups and then multiplying this probability 
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Considerable attention was given the case which computationally 
simplest. Even this relatively simple case were unable show the asymp- 
totic normality directly from {m(1)} except for the special case 
find the asymptotic distribution for any the joint distribution 
any set the proceed indirectly. 
Define the number lots (of size out that contain exactly 


i=0 
and that must have 


note that the joint distribution given above almost identical with one 
given Freund and Posner [1] for slightly different occupancy problem. 

proceed further, need know the proper norming for the which will 
presumably involve the means and standard deviations the 


this end, define 
Thus 
(3.5) 
apparent that 
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and find, excluding terms less, that 


k 2 


easy verify that Var 0(k); omit the exact expression since 
intrinsic interest and not important the asymptotic argument. 
are thus led define 


Because the constraints the clear that non-singular asymptotic 
the indicated transformations and going through routine argument using 
Stirling’s approximation, get 


— (s — 1) 2 


obtain the joint distribution the m(x) note that 
e-1 


i=z i=z 1 


a is. 


z-1 
1 


3 
= k, if f= 0 4 


asymptotically normal; similarly the joint asymptotic distribution any 
the multivariate normal. can verified that the variances 
and covariances the are given the summary, both the type 
computation indicated get the variance the and inversion the 
covariance matrix the distribution (3.9) and computation using (3.10). 

For the applications have mind, confidence bound the proportion 
defective items, must provide confidence bound the cumulative prob- 
ability function This will possible providing the cumulative 
monotone function (i.e. D). intuitively obvious that the cumulative 
m(x) monotone decreasing function but has not been possible 
show this analytically. lieu proof, Table below given which demon- 
strates the monotone relationship for the special case 12, 


TABLE 


1.00000 1.00000 1.00000 
99998 1.00000 1.00000 
99986 1.00000 1.00000 
43659 1.00000 
00346 99952 
00000 .00626 51159 
00000 00000 
00000 .00000 00000 


ADEQUACY THE ASYMPTOTIC THEORY FOR SMALL 


study the adequacy the asymptotic theory for small course 
complicated the computational complexity the exact distribution 
There are additional complications that both the skewness and the range 
the distribution m(x) depend not only but also and illustrate 
these points, give Table numerical comparison the adequency 
the normal approximation for cases that differ only the definition defective 
group, i.e. have different values. Asymptotic mean values and variances were 
used this computation. Agreement exact and approximate would 
presumably improved use exact moments. empirical continuity 
correction has been added each value Probabilities quoted should 
correct four decimal places. 

Table note that the distributions m(1) and m(4) are markedly 
more skew and have shorter ranges than the distributions m(2) and 
case the normal approximation too bad. Providing one not concerned 
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with very high very low probabilities, practical working rule use the 
normal approximation only the extremes possible values are 
ieast three standard deviations from the mean. This rule would exclude the use 
the approximation for the distributions m(1) m(4) Table The rule 
appears conservative. 


STATISTICAL APPLICATIONS THE DISTRIBUTION 


The random assembly problem have studied arises naturally and fre- 
quently and the various engineering methods used provide assurance against 
too many defective lots are not unlike the method proposed here. For example, 
designing hold down studs for reactor control drive mechanisms, engineer 
designs each stud withstand the maximum stress expected the stud will 
experience use. However, incorporates safety margin designing 
that two, say, instead four studs will contain the mechanism the maximum 
stress. Consciously, perhaps intuitively and imprecisely, tries bound the 
probability more than two failures any one the required sets studs. 
Because the number mechnisms generally small, the total number studs 
required will ordinarily randomly assembled into sets Consequently the 
problem sample testing, well that designing the studs can viewed 
the problem providing assurance against too many defective lots insuring 
against too many defective studs. 

Providing assurance arbitrarily low probability defective lot instead 
assurance arbitrarily low proportion defective lots not new. is, 
fact, the same kind protection variables sampling plans for 
percent defective. Since any finite lot finite number such lots can best 
viewed sample from infinite supply, confidence limits based con- 
tinuous distribution theory will relate parameters that distribution and 
therefore only the probability, average number, defective lots. Confi- 
dence limits parameters the continuous distribution permit such state- 
ments as: are 95% sure that the probability that the number 
defective groups greater than where either arbitrarily low 
arbitrarily low preassigned constant. 

many practical situations, particularly those wherein items are produced 
and made into batches sequentially, defectives will not occur randomly but 
with local positive contagion. That is, particular batch known contain 
defective, the probability another defective occurring the same batch 
thereby increased. other words, fewer batches will defective than would 
expected defectives were randomly distributed [providing the proportion 
defective items least Also from the very notion positive con- 
tagion would expect the probabilities for large decreased and the 
probabilities for small increased; this further suggests that expect 
the cumulative assuming positive contagion always greater than 
the cumulative assuming randomness. Consequently, expect assurances 
based the random assembly model will conservative. 

Implicit our discussion plan for acceptance-rejection lot batches. 
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would like the operating characteristic for such plan dependent 
solely upon the number defective batches must settle for 
dependence upon the number defective items the lot, some function 
thereof such the expected number defective batches, the case 
variables sampling, where the quality parameter average percent defective 
batch. 

apparent from the above discussion that any attributes sampling plan 
currently available can viewed plan affording some protection according 
any the criteria mentioned above. would simply plot the indicated 
power plan against Pr{m(x) mo} for suitable any other 
desired function overall proportion defective. 


TABLE 


From Infinite 
Accepting Process With Fraction 
the Lot E{m(3)} {m(3) Defective D/48 
1.000000 1.00000 
.00278 
.097198 


-09670 


-05631 


1.97206 


3.65106 


5.74635 


6.65211 
7.57077 
8.47641 


4 : 


For lot size and acceptable quality level 1.5%, Military Standard 
105B calls for normal sample size with acceptance number and 
rejection number The operating characteristic for such plan shown 
Table below for both individual submitted lot quality and for average sub- 
mitted lot quality. (This distinction not always made clear.) Two scalings 
the lot number and percent defectives (for the case where each submitted 
lot contains defectives) are shown, namely the expected value m(3) and 
Pr{m(3) 0}. Perhaps more useful concept would the prob- 
ability accepting lot with more than some undesirable number sublots 
containing more defectives. This perfectly natural way think 
power particularly the vendor submits lots already packaged into sets (i.e. 
the random assembly into subsets has already been effected). Hinges are often 
wrapped pairs; reactor fuel plates are often submitted the form finished 
fuel assemblies each containing dozen more Chart shows for various 
sample sizes the probability accepting lot subsets each when 
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DEFECTIVE ITEMS EVEN THOUGH 
SAMPLE ITEMS REVEALS 
DEFECTIVES. 


PROBABILITY 


TOTAL DEFECTIVE ITEMS 
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one more subset contains more defectives. The testing presumed 
destructive that the submitted lot size although the acceptance- 
rejection the lot and the quality thereof refer strictly the subsets 
each. The acceptance number taken zero; the rejection number The 
chart shows that sample sufficient keep this probability less than 
.03. Such function” can plotted against 
individual submitted lot quality against average process quality desired. 
should noted that the above example have considered destructive 
sampling while earlier discussion was implicitly terms non-destructive 
sampling. obvious that asymptotically this consequence; non- 
asymptotically this difference requires only obvious modifications. 

The distribution m(x) can also used decide whether not random 
assembly acceptable opposed selective assembly situations wherein 
the basic unit interest sublot items rather than individual item. 

First, however, would necessary decide upon basis for acceptability 
random assembly. might, for example, use random assembly 
solution for would give upper bound allowable grand 
lot proportion defective warranting random assembly. Alternatively, one might 
use random assembly 


for suitably small and Again upper limit given (approximately) 
solving 


using the normal approximation. 
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Outliers Patterned Experiments: 


Strategic Appraisal 


Bross 


Roswell Park Memorial Institute 


Factorial Daniel were presented the Christmas, 1959 
meetings the American Statistical Association. These papers, plus discussion 
William Kruskal, Thomas Ferguson, John Tukey and Gumbel were 
published the May 1960 issue Technometrics. The following paper Dr. Bross 
continues the exchange ideas the subject 


Statisticians are the business giving advice. One their favorite pieces 
advice research workers carefully plan their studies before under- 
taking them. What are the objectives the study? What are the salient features 
the experimental situation that will raise obstacles the attainment these 
objectives? How can these obstacles avoided overcome? other words 
statisticians usually advise their customers make thoughtful strategic appraisal 
before getting down work. This good advice. It’s too bad statisticians 
not follow this advice more often their own work! 

What should like here make strategic appraisal statistical 
problem—the problem outliers patterned experiments. The first extensive 
discussion this problem appeared the May, 1960, issue Technometrics— 
though the problem has been troubling investigators for least years. While 
the Technometrics discussion represents first step towards what Tukey (1) 
calls the elementary problems regard the papers 
Anscombe (2) and Daniel (3) something false start. Unless strategic 
made, the return elementary problems will yield only elabo- 
ration old solutions rather than the new solutions that are needed. 


One the main dangers making strategic appraisal that necessary 
deal with abstract concepts and doing may drift away from reality. 


‘To avoid this, good idea have concrete example hand. For this 


purpose shall use the artificial given Daniel (3, Table I). Although 
Daniel did not so, will suppose that the array Table the rows represent 
levels chemical the columns represent levels chemical and the entries 
represent the yield some product. have also rearranged Daniel’s table 
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Hypothetical Yields 


Levels 


might start asking: what way does the problem outliers 
patterned experiment such Table differ from the original outlier problem 
which the observations would regarded random sample from single 
population? What are the salient distinguishing features the situation 
patterned experiments? the observations represented the random sample 
could write them down any order sequence. patterned experiment how- 
ever there definite array due the pattern that has been imposed. other 
words start with set relationships between the 
ships which not depend the numerical values but rather the way 
which the experiment was laid out. addition there set relationships— 
pattern—of the numerical values themselves. This pattern evidently 
linked the imposed pattern. notice Table that and large the numbers 
increase move the right upwards. 

The above remarks may seen obvious but they have implications which are, 
perhaps, not quite obvious. particular are forced reconsider what 
mean the unpatterned experiment can concentrate 
the numerical value the value which stands off solitary grandeur. 
patterned experiment the numerical value the outlier may similar 
that number other observations. other words must consider both the 
numerical value and where occurs. outlier patterned experiment 
observation which, some sense, disrupts the pattern—a concept which 
quite different character from the corresponding concept for the random 
sample. 

Some further implications emerge. Let try pin down the definition 
outlier patterned experiment. Departure from pattern presupposes some 
non-null pattern. have characterize the pattern before can define 
departures from the pattern. practice would limited fairly simple 
characterizations though this restriction imposed our existing techniques 
and the phenomena under study subject such constraints. This brings 
another concept which has counterpart the original problem—the 
notion departure. observation were out line and the 
observations showed similar disturbance (though lesser degree) would 
tend regard this real departure from the presumed pattern (providing 
the observations were independent). the other hand observation stands 
out from its near neighbors would regard outlier. 
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OUTLIERS PATTERNED EXPERIMENTS 


the simple random situation there the further complication sampling 
variation. Due experimental error cannot expect find perfect pattern 
actual data. qualify outlier observation would have stick out 
like sore thumb—represent serious break the pattern. Which leads 
the following working definition outlier patterned experiment: 
outlier isolated observation which seriously disrupts the apparent pattern 
the data. 


III. OUTLIERS 


Statistical methods are sometimes advertised the way avoid the intrusion 
personal opinions and prejudices the interpretation data. Biostatistical 
methods serve this purpose. would naive however suppose that 
personal attitudes are completely nullified. These attitudes enter into the 
choice statistical methods and into their justification (although this point 
may well concealed the mathematics). Since outliers disrupt the patterns 
our first impulse eliminate them. Our attitude towards outliers cannot help 
but influence the way which set about this process elimination. Our 
attitude towards outliers depends turn upon how feel about throwing away 
data scientific studies. one hand may take detached” 
attitude and, like the Queen Hearts, around shouting with their 
This attitude reflected schemes for truncation data, elimination 
fixed proportion the observations, and other procedures which mechanically 
eliminate the observations. find this cavalier attitude rather distressing. 
Kruskal points out (4) immediate pressures practical statistical analysis 
are almost uniformly the direction suppressing announcement obser- 
vations that not fit the pattern; must maintain strong sea-wall against 
these pressures.” experience reputable scientists all fields have 
aversion—almost phobia—against leaving out data. the feeling (which 
share) merely the result clinging old scientific traditions? don’t think so. 
think this feeling comes from long experience (some recent) with people 
who are out prove their point and proceed eliminating 
observations. 

want make the point that the loss from omitted observations not 
measured the increased variance individual estimate. far publi- 
cations are concerned, the dropping observations loses the confidence 
thoughtful reader. Therefore feel should reluctant drop observations 
and should only for compelling reasons. 

cannot appear directly the technical manipulations, but think import- 
ant factor the strategic picture. Anscombe’s formulation omits 
this factor (2). the “insurance” formulation the dropping outliers 
minor premium that paid obtain safeguard against the major damage 
produced outliers. Hence the “insurance” view reflects the attitude that 
outliers are simply nuisance and the problem merely get rid them 
without losing too many non-outliers the process. 
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Now let turn the crucial question: What the principal damage pro- 
duced outliers patterned experiment? 

Most investigators who have used analysis variance (ANOVA) techniques 
patterned experiments have encountered what will call the burst’’ 
effect. This effect especially striking the factorials which are analyzed down 
high order interactions. Sometimes omission single observation leads 
ANOVA table which suggests null simple non-null situation. However 
inclusion this observation gives ANOVA table that gaily decorated with 
stars **) all and down the lines. analyst who was unfamiliar with 
this effect would conclude from the uncensored table that all sorts 
main effects and interactions are Hence the 
observation really meaningless the analysis leads complete mis- 
conception the underlying relationships the data. can safely say 
that outlier can great deal damage patterned experiment. 

There is, however, one very important point note. may attribute the 
damage the outlier but, fact, the combination ANOVA techniques 
and outlier that responsible for the burst” effect. think the 
outlier “contaminated” observation then the original data this con- 
taminator isolated single cell. the ANOVA techniques that spread the 
contamination throughout the results. The contamination gets into the column, 
row, and grand means and thence carried into all the estimates and significance 
tests. Other kinds analysis (eg. non-parametric) are likely much less 
affected the presence the outlier. This suggests that one strategy for 
dealing with outliers would shift some other type analysis. However 
what follows will stay with the strategy eliminating outliers. 

essential realize the role the ANOVA techniques the outlier 
problem—that they magnify the damage that the outlier can produce. More- 
over the vulnerability ANOVA techniques means limited outliers. 
The techniques are vulnerable other disturbances departures from the 
standard assumption—-non-additivity and heterogeneity variance, for example. 
Indeed given body data quite possible that several different types 
disturbances, including outliers, are present. Any device that set for 
eliminating outliers will have function the presence other disturbances 
and there risk producing unexpected and undesirable side effects. 

Turning back the question what the principal damage, there are two 
conventional answers. The first answer focuses estimation. The outlier puts 
major bias some the contrasts and lesser biases various other con- 
trasts. There also increase the variance the estimates. should 


noted that the increased variance not primarily due the slight reduction 
sample size (eg. which would multiplicative effect the order n/n 
but rather stems from the omission the most prominent member the sample. 
Anscombe has shown that the latter effect typically times greater 


than the former effect. The same remark applies when turn the second 
focus, significance tests. However the effect individual estimates tests 
less importance, think, than the overall damage that done. The principal 
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damage that with standard ANOVA methods the outlier can mess beyond 
all recognition the relationships between the variables. 

not easy assess the overall damage simple formula. However 
don’t think that our desire for simple mathematical derivation should 
allowed distort our strategic picture the problem. disruption the 
pattern relationships the principal damage, then this should our focus 
attention, even though the tactical problems are difficult. 


APPROACH 


The above strategic appraisal has, hope, helped clarify the nature the 
problem outliers patterned experiments. adopt the strategy elimi- 
nation outliers three questions naturally arise. How can tell there are 
outliers given body data? there are outliers, how can identify them? 
eliminate the identified outliers, how should the remaining data 
analyzed? 

The first question suggests that some type preliminary analysis for outliers 
made. What would the basis for such analysis? Both Anscombe and Daniel 
choose basis the departures the individual observations 
from their expected values (as calculated standard ANOVA methods for the 
given design). Table the expected values would be: Expectation row 
mean column mean grand mean. For example the lower left hand cell 
This natural basis but let consider the light the previous strategic 
appraisal. 

First all may note that there outlier the data then every residual 
will affected this outlier (Daniel calls them “biased Secondly, 
Anscombe points out, even without outliers the residuals complex design 
are correlated—sometimes highly correlated. This correlation pattern not 
all obvious anyone unfamiliar with the details specific design. third 
point note that the calculation expected values makes tacit assumptions 
about the pattern—additivity for instance—which can’t apply the outlier 
and may not apply the rest the data. Hence the use residuals basis 
has some serious tactical and strategic disadvantages. The main advantage 
that are able stay within the usual ANOVA conceptual framework. 

Without going into the technical details, let see the general route which 
would proceed from the basis. might consider that the problem has now 
been reduced the original outlier problem (with some complications). 
other words could consider only the magnitudes the deviations and reject 
those observations whose departures exceed (or some other multiple sigma). 
What have done, then, reduce the outlier problem patterned ex- 
periment the outlier problem random sample. From technical view 
such reduction highly desirable. From stragetic view, however, the key 
question is: Have thrown out the baby with the bath? Does this reduction 
preserve the salient features the patterned experiment problem? think not. 
have ignored the pattern the residuals have cut out the heart 
the problem. This, course, view only fair add that one the 
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discussants (5) considers that this approach will “the cornerstone which 
future generations outlier rejectors will base their work.” 

Daniel’s approach, while based residuals, something more than reduc- 
tion the original problem. remarks connection with factorials “if 
defective value which has expected value near one end the range re- 
sponses actually appears near the other end the range see alternative 
such cases making series trials, replacing turn each the responses 
the average the others, and then revising the estimates all effects ac- 
cordingly. one and only one the resultants sets permits simple regression 
equation, containing mostly main effects and interactions among the factors 
having large effects, then strong case can made for naming defective 
the value whose revision caused the While this approach may 
too cumbersome for actual applications, deals directly with the main 
damage—the disruption the pattern relationships produced outlier. 
Also tacitly takes into account the location the outlier. requires the 
investigator look his data and exercise certain amount judgment 
rather than apply automatic rejection process. practical approach 
tactically weak but strategically much stronger than the reduction process. 

Having observed some the difficulties encountered when residuals are 
used basis natural question is: have use residuals? The outlier 
problem patterned experiments represents the breakdown ANOVA tech- 
niques the presence disturbing factor. Would not more plausible 
turn techniques outside the ANOVA conceptual framework deal 
with the disturbing factor? Are there feasible alternative approaches? Let’s 
take look. 


VI. ALTERNATIVE LINE ATTACK 


Let review the strategic appraisal see suggests alternative line 
attack. the working definition, outlier isolated observation that 
seriously disrupts the apparent pattern the data. Does this suggest any way 
see outlier present, identify the outlier, and deal with it? 
are looking for sensible way proceed rather than neat mathematical 
derivation, then think the definition suggests alternative line attack. 
Let look back the data Table The first step ask: What the 
apparent pattern? Here think can say without much difficulty that the 
observations tend increase the right the Table. Technically 
might say that there joint monotonicity. The next step ask: Are 
there any apparent departures from this simple pattern? scanning the data 
become aware that there are several departures, some minor and some 
serious. For example the lower left hand entry out line with the entry 
above and the right but not very badly out line the sense 
that were 18.5 instead this irregularity would removed. the 
other hand the center row the fourth column there entry which 
distinctly out line with all its near neighbors. Moreover bring this entry 
back into line would have raised from 35.5. Here, then, have 
observation which satisfies the definition outlier. 
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The above remarks may call forth two very different responses readers. 
The first response, perhaps from persons experienced with data and analysis, 
would obvious! Any sensible investigator would this without all 
this elaborate strategic The second response, perhaps from technically 
minded readers, would this absurd! This gives the investigator 
license pick and choose the observations wishes discard. This procedure 
not objective and flatly contradicts the preceeding strategic 

answer the first objection can only say that the approach does seem 
have been “obvious” the outlier experts. answer the second objection 
would say that the task provide some type objective criteria based 
this line attack—a tactical problem. 

Can the line attack formalized? not hard derive more rigorous 
formulation (that gets into some unsolved technical problems) but are 
thereby led different for rejection. 

The central notion new formulation the pairwise comparison the 
observations array. The imposed pattern the experiment orders the 
observations—though not necessarily complete ordering. assume some 
specific pattern then can speak the expected direction pairwise com- 
parison. the observed direction differs from the expected direction then 
call the inversion. For example, proceeding the right along the 
bottom row expect the numbers increase. the six possible pairwise 
comparisons this row, four are expected direction, one (the entries the 
first two columns) inversion, and one case have tie. Ties present 
technical problem but they are relatively rare can simply count them 
half inversion. inversion count the table then can taken the basis 
for outlier elimination procedure. 

This formalization straightforward enough but tacitly assumes that 
there recognizable pattern the data. Before proceeding further with this 
approach might want some assurance that are not “seeing things” the 
data. There another reason for checking into the assumed pattern. grand 
null situation situation where large proportion the stimulus variables 
are null, are getting out the patterned situation and into the simple random 
one. Suppose for example that three the stimulus variables factorial 
are actually null. Then given outlier would one set eight measure- 
ments under effectively the same conditions. such degenerate cases would 
think using simpler procedure such replacement the outlier the 
average the other observations the set. what follows shall suppose that 
are non-null situation. This point can readily verified using pro- 
cedures which are relatively insensitive the presence outliers. 

Table for example, have our disposal the Sequence Sign Test and 
other devices that are based inversions. These procedures are hardly more 
trouble than simply scanning the data. For example let consider the rows 
Table Here inversion will occur the right hand member paired 
comparison has lesser value than the left hand member. Thus the top row 
there one inversion, the next row there half inversion, the middle 
row there are three inversions, the fourth row half inversion and the 
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bottom row one and one-half inversions. All told there are inversions out 

test for monotone relationship the rows subtract the number 
inversions, 64, from the number non-inversions (30 234) get 
234 17. subtract one more for continuity correction, giving and 
square obtain numerator 256. Dividing the total number pair- 
wise comparisons, 30, gives 256/30 8.53. this point have simply 
carried out ordinary sign test. However take account the fact that the 
six pairwise comparisons are not independent must introduce multiplicative 
correction factor. The denominator the correction factor twice the number 
entries the rows plus five. Here would 13. The numerator 
the correction factor that the value here 9/13 0.69. Multiplying 
8.53 this correction factor gives 5.89. The usual critical values for the sign 
test apply here that the level 3.84 and the level 6.64. Even with 
possible outlier can reject the hypothesis null effect along the rows 
the level. derivation the Sequence Sign Test can found recent 
paper Statistical Criticism (6). 

have dealt with this tactical finesse some length because illustrates, for 
readers not familiar with inversion methods, just how simple and straight- 
forward the tactics can be. Applying the Sequence Sign Test the columns 
find inversions the first three columns and inversions the right 


Inversion Tables (For Table 


(a) 


Number Row Inversions Cell 
(in Pairwise Comparisons) 


Levels 


(b) 


Number Column Inversions Cell 
(in Pairwise Comparisons) 


Levels 
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OUTLIERS PATTERNED EXPERIMENTS 
(c) 
Main Diagonal Inversions Cell 


(Number Pairwise Comparison Denominator) 


Levels 


0/4 0/8 0/12 
0/3 0/5 0/7 0/9 
0/6 0/6 0/6 4.5/6 
1/7 1/5 0/3 


(d) 
Cumulated Inversions Cell 
(Number Pairwise Comparisons Variable) 


Levels Total 


hand column. The Sequence Sign Test gives numerical value 13.5 which 
again significant the level. the reader takes the trouble through 
the actual calculations will struck, think, that the fact that pairwise 
comparisons involving one the cells account for sizable proportion all the 
inversions. This point can made clearer counting slightly different 
fashion. count each inversion twice, once for each member the pair, 
obtain the inversion tables shown Table II. The point this symmetrical 
method counting inversions that can associate count with each cell 
the original table. Table II(a) shows the inversions for the rows, Table II(b) 
for the column, and Table II(c) for the main diagonal comparisons which 
will come shortly. Table (d) merely sums the inversions the three previous 
tables. Inspection Table suggests very strongly that there outlier 
this data. Indeed locates the trouble spot for us. see that the central row 
and the right hand column give the most inversions. would suspect that 
outlier occurs the middle row the right hand column. All that has really 
been done here systematize the scanning approach which was introduced 
the start this section. want formal, objective elimination rules 
inversion count the form Table provides basis. 

Table (c) concerns main diagonal comparisons, that comparison 
observation with the observations below and the left the table and 
the set observations above and the right the table. should 
noted that joint monotonicity specifies the direction these comparisons but 
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does not specify the direction the minor diagonal comparisons. Minor 
diagonal comparisons provide information the relative strength the two 
factors—a question don’t wish get into here. They are therefore omitted. 
interesting that table main diagonal inversions the only inversions 
that occur involve the suspected outlier. general simple joint monotone 
relationship exists would expect find the proportion inversions going 
down the pairs the comparison are farther apart. This fact might used 
distinguish outliers from minor discrepancies the pattern. 


DEVELOPMENT 


While will not into the tactical development, want say little 
about the general lines that might taken. One approach would focus 
the proportion all inversions that were produced given observation. 
For example could divide the number inversions the number cells. 
given observation produces substantially more inversions than its 
would candidate for elimination. For example have inversions all 
Table (d) and the quota would 31.0/20 1.55. Our suspect thus exceeds 
its quota many times over (9/1.55 5.81). 

this point might objected that the inversion approach does not take 
into account the actual magnitude the observation. This valid objection 
but don’t feel that are under any compulsion confine ourselves 
single approach—even though this would simplify the theory. can bring 
the magnitude considering how much the observation would have 
changed order eliminate the inversion. this change was the order 
magnitude several standard errors this would provide additional reason 
for rejection. Since take reluctant attitude towards rejection data would 
favour basing the rejection all the information that would relevant 
the decision. sure this presents difficulties the calculation rejection 
rates and other performance measures but regard this secondary con- 
sideration. 

take direct account the numerical values the procedure that Tukey 
calls (1) can used. eliminate the middle entry the 
right hand Table what value would use its place avoid the 
inversions? using number greater than would avoid the row inversions. 
using number greater than and less than could avoid the column 
inversions. using number greater than could avoid the diagonal 
inversions. general would obtain this way set inequalities set 
depending the number variables and the location the outlier). obtain 
definite replacement could use, say, the average the upper and lower 
limits. this example this would the average and 35.5. 

avoid inversions have raise the entry from 35.5—or 15.5 units. 
had previous experience with the experimental error similar experiments 
could compare the change, 15.5, with the previous estimate Lacking 
past experience could calculate the error mean square for the patterned 
experiment (using the replacement needs be). Daniel gives the mean square 
2.47 (and the square root would 1.57) see that the change times 
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the standard error. can build strong case for elimination the outlier 
utilizing additional information this way. 

The process Winsorization also provides plausible answer the question: 
eliminate the outlier, how should the data analyzed? want 
use ANOVA techniques can restore the balance replacing the outlier 
its Winsorized estimate. Doubtless this suggestion will not sit well with the 
devotees current missing plot techniques but have already swallowed 
camel why strain gnat? would like stress that the use ANOVA 
techniques that makes important replace the outlier with some fictitious 
value. The techniques related the Sequence Sign Test can applied merely 
omitting the outlier. 

Significance tests and formal rules for rejection outliers could based 
inversions and this area open for tactical development. There the technical 
difficulty that the theoretic distribution inversions for non-null cases not 
known. One possibility would apply the usual outlier theory the empirical 
distribution inversions (eg. Table II) but there are two technical hitches. 
noted earlier, the non-null case the probability inversion would depend 
the location the two entries the pairwise comparison. Also the entries 
Table are not independent. There the further problem combining row, 
column, and main diagonal inversions. While would nice have formal 
test here have the feeling that when have bad outlier (as here) then 
formal test really gilding the lily. 

are willing discard some the information not hard set 
approximate significance test. Leaving out the row the suspected outlier 
have (counting inversions the usual, non symmetrical manner) 
and row inversions. The mean this series 7/8 and the usual estimate 
variance would 11/48. Leaving out the column the suspected outlier 
have and column inversions. The mean this series 5/6 and the variance 
1/12. Now consider total the inversions row and those column. 
Call this total would then expect equal 7/8 5/6 1.71. 
would estimate the variance 11/48 1/12 .31 and the standard error 
.56. the usual rule would expect lie between and 2.83. The 
sum the row and column inversions for the row and column containing the 
suspected outlier which lies well outside the expected range. 

don’t want give the impression that tactical development along these 
lines either easy unnecessary. have mentioned the nasty problem 
partially ordered patterns. the example have assumed natural ordering 
(by amount chemical) but many patterned experiments there may only 
partial ordering even ordering all. this case can use the response 
variable for the orderings but this gets into various complications. further 
difficulty comes patterned experiments where simple monotonic relation- 
ships are unlikely. think that the nature the patterns likely found 
given class data determining factor the outlier methodology would 
want use. Finally want mention again the problem simultaneous 
occurrence other disturbances apart from outliers. While the inversion ap- 
proach probably less affected such disturbances than approach based 
residuals, not completely immune. 


IRWIN BROSS 


VIII. 


strategic analysis the problem outliers patterned experiments 
reveals serious shortcomings the current approaches and suggests rather 
different line attack. While this strategic appraisal open arguments and 
objections—as almost any such appraisal will be—I believe will serve 
illustrate the need for such appraisals, the nature such appraisals, and the 
practical value making strategic survey before undertaking tactical develop- 
ment. this case the outlines tactical development emerge from the 
strategic appraisal—I must confess way not expected when started the 
appraisal. The strategic appraisal defective the sense that does not follow 
through with the tactical details—and strategic appraisal limited practical 
value until there tactical follow-up. Many the current papers the 
statistical literature are very strong tactically but are strategically unsound 
paper with the opposite fault least contributes some variety. 
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Multiple Comparisons with Control 
Balanced Incomplete Block Designs 


Cornell University 


This paper shows that Dunnett’s procedure for making multiple comparisons 
several treatments against single control can used the adjusted treatment 
means from balanced incomplete block designs. 


Dunnett (1955) published tables for one- two-sided multiple comparison 
treatments with control. His tables are constructed for the case where 
the treatment means and the control mean are mutually 
independent and normally distributed with common variance estimated 
where known constant and chi-square distributed with 
degrees freedom, independent the means. Under these assumptions 
the chance variables 


fori --- have the multivariate normal distribution with means and 
variances and with correlation between and Utilizing tables 
prepared the National Bureau Standards, Dunnett then tabulated the 
values and for which 


P, Pr (Z, < ts, < 8, 


The application Dunnett’s test the adjusted treatment means from 
balanced incomplete block design (utilizing only the intrablock information) 
might first appear questionable since this case the adjusted means 
are not independent. Because the balanced condition, 
however, all adjusted treatment means have the same variance and all pairs 
have the same covariance. Consequently, for0 


where the intrablock error variance, the number replicates each 
treatment and the efficiency factor the design. The adjusted variables 
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are therefore also normally distributed with means variances and pairwise 
correlations 

This justification for the use Dunnett’s test with balanced incomplete 
blick designs also implies the applicability other procedures this type; 
e.g., those Tukey (1953), Bechhofer (1954), and Duncan (1955). 


application Dunnett’s test doubly balanced incomplete block design 
illustrated below for taste-testing experiment conducted Wallace 
Cornell University. The doubly balanced design which each pair treat- 
ments occurs together equal number blocks and each triplet together 
blocks was constructed Calvin (1954) eliminate from error the cor- 
relation effect common the and jth treatment when both are the same 
block. The present experiment, which cabbage varieties were 
compared with standard, was designed with the parameters and 


number varieties per block 


giving 


Raw cabbage samples presented the tasters were scored for texture five 
point scale. 


TABLE 


Analysis variance cabbage texture scores. 


Scorce d.f. MSS. 
Total 119 
Blocks (unadj.) 16.575 .5716 
Varieties (adj.) 48.127 5.3474 
Correlations (adj.) 35.333 1.25 
Error 35.290 7842 


The experimenter this case wished determine which cabbage varieties, 
any, differed from the standard variety average texture score. Adjusted 
treatment means were computed according the procedure outlined Calvin 
and the deviations from the control were tabulated rank order, 
shown Table Dunnett’s tables were entered find the value 
the 95% level, which for treatments and degrees freedom 2.90, 
and the tabulated differences were then compared with the allowed difference 
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MULTIPLE COMPARISONS WITH CONTROL 


+1.15 


TABLE 


Ranked deviations adjusted treatment means from the adjusted control mean 


Only the lowest the treatment means was significantly different from the 
control mean. 
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Bounded Relative Error for the 
Mean Life Exponential Distribution’ 


BENJAMIN 


Wayne State University and Stanford University 


THE PROBLEM 


Consider random variable having p.d.f. 


this note find estimation procedure for the mean life having small 
relative error. Put more precisely, show how get estimate which is, 
with some preassigned confidence within certain percentage (100 
percent) the true but unknown mean life the language life testing, 
this will require observing suitably large number failures, 

The exact solution the problem involves considerations like those [1]. 
Suppose that fixed number, failures observed, and suppose that the 
associated total life then can shown that the “‘best’’ estimator 
the minimax sense corresponding the loss function 


(2) 
otherwise 


given the estimator 


Equation (4) suggests that when and .1, reasonable ask 
for what values 


safely assume that (6, approximately distributed N(0, 1). 
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Thus meet the conditions imposed (5) means that must chosen 
such way that 


(6) 


where 


.01, .05, .10 and .01, .05, .10 the values required are tabulated 
Table 


TABLE 


6, = 6 


66,400 38,400 27,100 
2654 1537 1082 
664 384 271 


interest show how one can compute, for any preassigned the 
log 6/1 This particular importance when small (and hence 
asymptotic theory longer valid). can verified that for any preassigned 


6 ei(r,5) 


(7) 


ker 


NUMERICAL EXAMPLES 


How many tubes should tested order that there probability 
least .90 that the estimate within 10% the true mean life? 

Solution: the notation (5) and (6), .1, andc, 1.645. 
Therefore the number tubes tested should 271. 
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the underlying distribution exponential this means that must observe 
least 271 failures order get estimate such that can 90% confident 
that the estimator within 10% the true but unknown mean life. 

have available information from life test which failures occurred 
with associated total life 1000. Assuming exponential distribution, 
find the minimax estimator associated with the loss function 


otherwise. 
Also compute the confidence that will have the correctness the assertion 


Solution: From (3), the minimax estimator based the failures 
given 2(.2)(200)/log (1.2/.8) 80/log (1.5) 197. find the con- 
fidence our assertion that 1.2, use (7) and (8). This gives 


Confidence p(k; 6.08) p(k; 4.06) .7255 .3829 .3426. 
k=5 
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Methods Constructing Sets Mutually 
Orthogonal Latin Squares Using Computer. 


University North Carolina and Case Institute Technology 


new class triplets mutually orthogonal latin squares derived. These are 
the consequence attempts extend the results described Part this paper 
which appears Technometrics, 1960, Vol. No. 507. 


Introduction, Notations and Motivation 


[1] method searching for sets mutually orthogonal Latin squares 
size where the order Hadamard matrix given. The method 
based the concept orthogonal mappings group, due Mann [4]. 
For the group order the module G(2, whose elements are vectors 
(a, where residue class (mod and residue class (mod used. 
The group operation (addition) defined 


(0, 0), (0, 1), (0, 1), (1, 0), (1, 1). 


also use the notation 


and then have 


The rows square are made correspond (1, the elements 
and column said the cell (x; x;) and the basic square has the entry 


This research was supported part the United States Air Force, through the Air 
Force Office Scientific Research the Air Research and Development Command, under 
Contract No. 49(638)- 213. Reproduction whole part permitted for any purpose 
the United States Government. 
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rows 

was then shown that the search for orthogonal mappings was materially 
simplified using configuration based the balanced incomplete block 
design with the parameters 


equivalent Hadamard matrix order Using this method two sets 
five mutually orthogonal Latin squares order were obtained. The mutually 
orthogonal Latin squares set, derived using orthogonal mappings 
group enjoy the property [2] that all the members can obtained from the 
basic square row-permutations alone. But following method [1] could 
generate for 12, sets five mutually orthogonal Latin squares and more. 
set mutually orthogonal Latin squares required the squares set 
satisfy property less restrictive than This search was not successful. 
However, interesting class triplets mutually orthogonal squares 
possessing the property was discovered. 

Let regard each row square consist two half-rows the first half 
the cells the second half-row are those belonging the columns 
Instead now require our standard Latin square orthogonal have 
its first half-rows permutation the first half-rows and similarly 
its second half-rows permutation those 


Use double-maps the group generate orthogonal squares. 


Consider two (1, mappings and (not necessarily orthogonal) the 
putting the cell the entry 


Theorem 2.1. square whose cells are filled (2.1) Latin square 
and only 


(2.1) 


Proof. Obviously, every column all the elements occur. For given 
and 
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Hence, for given all the elements will occur row 

Converse easily proved. 

Consider Latin square which based double-map (8, Specifi- 
cally, and satisfy 


for every now require the condition that this Latin square 
orthogonal 
Let denote the set elements such that for every 


Similarly, define 
and also 


the same true and These are consequences and satisfying 
(2.2). 


the two squares are mutually orthogonal, then known [3] that the 
pairs which are all different fall into different classes—each class having 
pairs. Any two members belonging the same class have the same difference 
associated them and ranges over all the elements Given pair 


which has the difference the members belonging its class are obtained 


+ 2 


Consider the ordered pairs, 


pairs (2.3). Now, the differences 


(2.4) 


7 
3 a 


generate all the elements then all the ordered pairs 


mapping defined 


(2.5) 


orthogonal mapping Similarly, require that the mapping defined 

Ba S,(8) 
(2.6) 


Theorem 2.2. Latin square L(8, based double map 


easily seen that given two orthogonal mappings and such that 
P,(ax) for every inG 


one can always define double-map (8, 8*) based (a, a*) the manner 
theorem 2.2, generate new Latin square orthogonal and 
different from L(a) and L(a*). 
Illustrations double-maps: 
For the mappings and given below are orthogonal mappings 

G(2, 6). 


Then and derived from and are follows: 


and 


are 
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The underlined elements the maps and constitute and the rest 
The Latin square based the double-map and given the next page. 


Mutually orthogonal double-maps 


For [1] sets orthogonal mappings --- S,, were obtained. 
Number mappings n(S;) the sets are given below: 


TABLE 


From the results Section follows that the method double maps 
can generate n(S;) n(S;) Latin squares orthogonal using map- 

Next the problem was one matching for orthogonality double 
the mappings and 


are orthogonal mappings. 


Using this condition for orthogonality, obtained 228 pairs mutually 
orthogonal double maps constructed one from each set and This 


| 


means including got 228 triplets mutually orthogonal Latin squares 
order 12, based double maps one each from sets and However, 
extensive search the computer, could not get set four mutually 
orthogonal Latin squares based double-maps which are not trivially orthog- 
onal maps (a, 

triplet mutually orthogonal double-maps which one given 
the following page. and are two orthogonal mappings from set and 
and orthogonal mappings from Double maps 6%) and 6%) 
are derived respectively from and (a; the manner illustrated 
Section 


are given Figure The symbols 00, 01, --- have been changed 
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Book Reviews 


and Harry Sampling Inspection Tables, Single and 
Double Sampling, 2nd. ed. Revised and Expanded. New York: John Wiley and Sons, 
Inc., 1959. xi, 224 pp. quarto, $8. 


The ground-breaking work Dodge and Romig the development sampling inspec- 
tion came its culmination with publication their sampling tables the Bell System 
Technical Journal January, 1941. These were later put together with mathematical and 
other explanatory material and published Wiley book form 1944. The Tables have 
for many years been used widely industry and their contributions the spread sound 
quality control methods was good measure responsible for the authors being individually 
awarded the Shewhart Medal, Dodge 1949, Romig 1953. 

The sampling plans the Dodge-Romig Tables are minimum total inspection plans, i.e., 
they are designed yield, for specified process average, minimum long range average 
amount inspection, including the inspection rejected lots well inspection the 
sample. They are indexed with reference the Average Outgoing Quality Limit (AOQL) 
and the Lot Tolerance Per cent Defective (LTPD) (the latter for Consumer’s Risk 10%) 
and are classified with respect lot size and process average. They thus stand contrast 
the Mil. Sid. tables, subsequently published the Department Defense, which are 
indexed with respect Average Quality Level (AQL) only. 

The numerical tables the revised edition are the same the numerical tables the 
original edition except for minor changes lay-out. Since the new volume has approximately 
double the dimensions the old (the new pages are now the tables are set 
larger size print. The term Process Average and the symbol also now appear the head 
each column instead only the margin. Both these changes will increase the accuracy 
and ease using the tables. minor change that the reviewer did not like was the omission 
from the LTPD tables themselves any statement the Consumer’s Risk. 

The major changes the volume whole are the addition Operating Characteristic 
curves and the enlargment the introductory chapter include detailed directions how 
choose sampling plan. The content the original text Chapters and remains 
substantially unchanged. 

One hundred and nine pages the new edition are used present the curves the 
tabulated AOQL plans. Generally four charts are shown each page and the 
charts frequently contain curves each. Like the numerical tables, the curves are indexed 
and grouped lot sizes. curves for single sampling plans are based exact 
binomial formulas, but those for double sampling plans are based the Poisson approximation 
when sample sizes are large. 

the text, methods are given for deriving approximate curves for the tabulated LTPD 
plans from the curves given for the AOQL plans. Eight pages are also used present general 
set curves for single sampling plans for and 500. These curves are 
indexed with respect and grouped according values 

their discussion curves, Dodge and Romig distinguished Type and Type 
curves. Type curves are defined curves showing the probability accepting 
lot function lot quality. Type curves are defined curves showing the probability 
accepting lot function process quality. The authors point out that Type curves 
are identical with Type curves for since lots can viewed random samples 
from controlled process with fraction defective their lot qualitites will binomially 
distributed and samples from such lots may treated they were actually samples taken 
directly from infinite universe having fraction defective 

The curves given the Tables are all Type curves, i.e., they show what per- 
centage lots would accepted the process running (in control) the level. The 
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authors point out that not designated the original published papers Chapters 
and the Consumer’s Risk, used there, more specifically, the Consumers’ Risk, and 
the Producers Risk, used there, the Producers’ Risk,” (p. 56.) 

This publication the curves for the AOQL plans welcome addition 
the original tables and will make the plans more generally useful. Reiteration their 
emphasis upon AOQL type plans may also possibly induce the federal government re- 
consider the AOQL aspects Mil. plans. 

noted above, Dodge and Romig base the character their plans squarely 
the attainment minimum quantity total inspection. was therefore little dis- 
appointing the reviewer that they did not some place the revised edition discuss recent 
approaches the problem sampling inspection that seek minimize overall cost, including 
the cost passing defective unit well the cost inspection. The authors, however, 
give the user the tables the following advice. ‘‘In choosing value LTPD (or AOQL), 
consider and compare the cost inspection with the economic loss that would ensue quality 
bad the LTPD were accepted often (or the average level quality were greater than 
the AOQL). Even though the evaluation economic loss may difficult, relative values for 
different levels per cent defective may often (p. 6.) 

Acheson Duncan 


Howarp “Dynamic Programming and Markov (Technology 
Press and Wiley: 1960) pp. 136, $5.75. 


Statisticians, industrial engineers, operations research analysts and other technical 
personnel are frequently called upon either provide counsel execute the solution 
problems involving models operational systems. This short, easy read, and highly stimu- 
lating book will helpful such people framing and solving certain types mathematical 
models. 

The author’s purpose develop computational technique—similar dynamic pro- 
gramming—for solving particular problems arising from Markov processes. These problems 
pose the following question: how maximize the attainment some “reward”, which 
linked Markov process, through the manipulation parameter (the available policies). 
The iterative method suggested Howard offers the advantage being adequately de- 
scriptive, computationally feasible and usually providing the solution small number 
iterations. 

Chapter deals with discrete-time Markov processes. The author presents simple ex- 
ample Markov process the behavior frog lily pond. Each lily pad state 
the system. given point time the frog occupies the pad (the state where 
discrete-time intervals and his transition time instantaneous, have discrete-time 
Markov process. The probability moving from state state for every state may 
known. thus possible define transition matrix which consists all transition prob- 
abilities. 

early stage the analysis the author introduces generating function called 
z-transform. The z-transform provides both limiting state probabilities (i.e. the probability 
distribution state occupancy after large number leaps, time intervals) and ex- 
pression for evaluating the transient behavior the system. This followed discussion 
the application the z-transform systems portraying multichain and periodic behavior. 

Chapter introduces reward variable, which assumed function the transi- 
tion made the system. This implies that the reward depends upon the transition matrix. 
the case involving our frog, the reward structure could emerge from set friendly wagers 
between another party and oneself and hence, from point view, some rewards could 
positive, others negative. the author’s models, the dimension the reward arbitrary, 
one can deal with dollars physical units. 

After introducing definition ‘‘expected reward’’, which dependent upon the initial 
state, the z-transform applied the definition facilitate deriving total rewards” 
function time. this case the process assumed have but one recurrent chain. 
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Suppose now that are able influence the movements the frog (by perhaps prodding 
him with electric shock). If, while sitting the pad, the charge applied his 
head, his response may described new vector transition probabilities. There may 
alternative body locations which the charge may applied. For each pad which 
may occupy arbitrarily assign particular surface the frog’s anatomy for prodding, 
i.e. each state one, and only one, surface assigned. This N-component vector assign- 
ments called There exist, course, number policies, depending upon 
and the number alternative body surfaces available for each state. 

Given the expected reward function for the system the author illustrates how the total 
expected reward can maximized choosing appropriate policy. chapter this 
accomplished iteration. But this only feasible the number time intervals, small. 
Suppose large. Then turn Chapter where Howard’s main contribution, the policy- 
iteration method, clearly explained. 

There one other difference introduced this point: for large number time intervals 
more useful maximize average gain per transition rather than gain. With this 
change maximizing criterion, and assuming both large and that the limiting state prob- 
abilities for each policy are independent the initial state, the policy-iteration method 
derived. The optimal policy vector, with components specifying the decision made 
each state, and will usually found small number iterations. 

Simple but clearly explained applications the method problems taxicab operation, 
baseball strategy, and automobile replacement constitute the subject matter Chapter 
The last application particularly revealing and useful since many replacement problems 
industry possess similar logical structures. The reader will find this chapter ready 
computational technique for solving such problems. 

Chapter deals with extension the policy-iteration method Markov processes 
with more than one recurrent chain. such cases the limiting state probabilities depend 
upon the starting state and the policy-iteration method Chapter revised accommodate 
this fact. 

Chapter find revision the method reflect different criterion: maximizing 
the present value the expected reward. other words, the rewards are discounted give 
effect the fact that immediate rewards are valued more highly than future rewards. Some 
insights are provided indicating numerical values the discount factor that are important 
and under what conditions the no-discount solution previous chapters will equivalent 
the discount solution. 

Finally, the methods are extended embrace continuous-time processes—i.e., the time 
between transitions random. For the study such Markov processes the Laplace transform 
introduced supplant the z-transform. policy-iteration method, analogous the one 
derived for discrete-time processes, developed for solving long-duration continuous time 
decision problems involving rewards. Fortunately, the two procedures are computationally 
equivalent, that computer program developed for one procedure may employed 
solve problems posed the other. The continuous-time-policy iteration method, like the 
discrete-time method, can modified handle discounting expected rewards. 

excellent feature this book the liberal use carefully chosen illustrative examples, 
literally one support each new idea. 

The book designed for advanced courses operations analysis systems design courses 
the graduate level schools engineering. But will also serve excellent reference 
for technical personnel who are called upon study Markov processes, mathematical models 
based upon Markov processes, similarly structured problems. 

William Beranek 
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Statistical Programs for High Speed Computers 


Assembled for Technometrics 


1961 


Frep LEONE 


Readers are requested send brief de- 
scriptions computer programs interest 
statisticians Dr. Fred Leone, Di- 
rector, Statistical Laboratory, Case Institute 
Technology, 10900 Euclid Avenue, Cleve- 
land Ohio for consideration for publication 
Technometrics. Each computer program 
announcement contain: 

brief problem description, The 
type computer for which the program 
applicable, The author’s name and address, 
brief description the program in- 
cluding: Limitations, auxiliary equipment 
requirements, statements accuracy, avail- 
ability sample problems, running time 
estimates and programs storage requirements. 
All programs submitted for publication must 
available for distribution subject only 
nominal costs for the reproduction and mail- 
ing program tapes, cards, etc. Inquiries 
about published programs should ad- 
dressed the authors. Comments and 
critiques the published programs may 
sent Dr. Leone and will published 
when considered appropriate. 


Multiple Regression Stepwise Procedure, 
No. 6015 IBM 650 With 
Alphabetic 


This program performs multiple linear 
regression stepwise procedure providing 
number intermediate equations 
one variable time. The variable 
added the one that makes the greatest 
improvement “goodness Only 
‘significant variables are included the 
final regression. can used with 
independent variables. limits the 
number sets data. Data must coded 
that the largest sum squares less 
than Weights can assigned each 
set data. Procedure provides for entering 
and removing variables specified levels 
-of significance. This program was success- 
fully run and sample problem and flow 


Case Institute Technology 


123 


diagram are available. Efroymson and 
Schricker, Computing Center Esso Re- 
search and Engineering Co., Florham Park, 


Modified Principle Axis Factor Analysis 
Solution, No. 0018, August 1958, IBM 650 


solution, for symmetric 
matrices order convergence can 
obtained the vectors the right or- 
thonormal (eigenvectors) and elements the 
basic structure delta matrix (square root 
the The orthonormal vectors 
are also multiplied the corresponding 
delta elements produce vectors the 
principal axes factor loading matrix. Succes- 
sive residual matrices may punched out, 
and factor extraction continued until the 
sum the squared elements the delta 
matrix equals exceeds some specified value. 

The program not limited positive 
definite matrices and has been designed 
automatically process negative delta ele- 
ments. When all systematic variance has 
been extracted, negative deltas may auto- 
matically follow, thereby reducing the sum 
the elements that the stop value never 
reached. Under these conditions, extraction 
may continue until machine overflow occurs 
when division zero attempted. addi- 
tion its employment the investigation 
basic structure, this program may also 
used for the rapid determination the 
rank symmetric matrix. This program 
can employed factor symmetric matrices 
order 47. Only the infradiagonal and 
diagonal elements are loaded, and diagonal 
elements may may not unity. The 
program self-restoring, and need not 
for input and output forms are provided. 
This program was successfully run. 
diagram nor sample problem available. 
Director, Div. Counseling and Testing 
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Services, University Washington, Seattle, 
Washington. 


Statistical Multiple Correlation and Regression 
Analysis, UNIVAC 


This program can handle variables, 
any number these may independent 
dependent. The original input matrix could 
unityped prepared the computer 
from some previously converted data. Card 
layout forms and card-to-tape plugboard 
wiring diagram for the preparation the 
input are given. predicting equation 
the form 


will found for each variable. The con- 
stant term and the regression coefficients 
appear elements output matrices, 
regardless the total output matrices, 
regardless the total dependent variables. 
The matrices contain such answers the 
means and standard deviations the original 
variables, the beta coefficients, the correlation 
coefficients between each the independent 
variables and between the independent and 
dependent variables, the multiple correlation 
coefficients squared, the residuals, the stand- 
ard errors estimate, the values, the 
regression coefficients, and the estimated 
value This routine completely auto- 
matic, requiring type-ins operator 
intervention except case situations 
requiring reruns. This program was success- 
fully run and flow diagram available. 
Director, Research and Technology Dept., 
National Tube Division, United States Steel 
Corp., Pittsburgh, Pa. 


Data Screening No. BIMED No. 015, 
March 10, 1960, IBM 709 


This program for testing input data 
which may used for statistical analysis 
later stages find the form their 
distributions, frequencies, and possible out- 
liers. Input data may consist sets 
data containing variables with the following 
limitations: 


This program can perform different 
transformation any variables, desired, 
according the code specified the Selec- 
tion Card. listing the transformed and 


untransformed data provided desired. 
order process numbers any size, 
the data for two selected variables are con- 
verted into the standardized form before 
they are screened and cross tabulated. Ex- 
treme values the data are identified and 
printed the output. This program was 
successfully run and sample problem 
available. Professor Dixon, Div. 
Biostatistics, Dept. Preventive Medicine 
and Public Health, School Medicine, 
University California Los Angeles, Los 
Angeles 24, 


Data Screening No. BIMED No. 016, 
March 10, 1960, IBM 709 


This program computes (1) frequency dis- 
tributions, (2) means, variances, standard 
deviations and standard errors means for 
specified set variables conditioned 
one variable within the set, (3) correlation 
coefficients for the specified set variables. 
The input data consists sets vari- 
ables with the following restrictions 

This program can perform different 
transformation any variable, desired, 
according the code specified the Trans- 
formation Card. This program has been 
successfully run and sample problem 
available. Professor Dixon, Div. 
Biostatistics, Dept. Preventive Medicine 
and Public Health, School Medicine, 
University California Los Angeles, Los 
Angeles 24, California. 


Least Squares Curve Fitting, 6.0.501, IBM 650 


polynomials degree less than specified 
The weights, may either specified 
part the empirical data, explicit 
function available, may calculated 
within the program. Fits the 24th 
degree using all powers, 48th degree 
using only even powers, 49th degree using 
only odd powers for most 100 experimental 
data points. All arithmetic floating 
point. The program does not need equally 
spaced values the independent variable 
which important feature the set 
orthogonal polynomials used. The coefficients 
orthogonal polynomials not depen 
the maximum degree specified. This pro- 
gram was successfully run and sample 
problem and flow diagram are available. 
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Director, Computing Center, University 
Rochester, Rochester, New York. 


Least Square Curve Fitting Unequally 
Spaced Points with Orthogonal Polynomials, 
No. 1006, April 1958, IBM 650, SOAP 
Complier (Developed Case Inst. Tech.) 


Given set empirical data yu) 
polynomials degree less than equal 
10. The program does not need equally 
spaced values the independent variable 
which important feature the set 
orthogonal polynomials used. The coefficients 
orthogonal polynomials not depend 
the maximum degree specified. This pro- 
gram was successfully run and flow diagram 
available. Director, Computing Center, 
Case Institude Technology, Cleveland 
Ohio. 


Fitting Unequally Spaced Points with 
Orthogonal Polynomials, No. 1032, Sept. 1960, 
220 ALGOL (Burroughs Algebraic Com- 
piler) 


This program will find the coefficients 
the polynomial 


which gives the best fit least squares 
sense data points (up 500 pairs) where 
the maximum value does not exceed 
fifteen. The data points may arbitrarily 
spaced. The algorithm does not use the 
equations approach but employs 
orthogonal polynomials. This program was 
successfully run and sample problem and 
flow diagram are available. Director, Com- 
puting Center, Case Institute Technology, 
Cleveland Ohio. 


Analysis Variance, IBM 650 Basic 


The programs developed perform 
Analysis Variance any five types 
experiment designs: one way classification 
variates, randomized block, latin squares, 
split plot and split-split plot. attempt 
has been made allow for flexibility input 
and output making provisions that allow 
the input data coded either fixed 
floating-point form. The following are limita- 
tions: 

(1) The maximum number treatments 

one way classification variates 
100. 


(2) The maximum number replicates 
treatments allowable randomized 
block experiment 100. 

(3) The maximum latin square allowable 
100 100. 

(4) The restrictions the split plot pro- 
gram are: 

(a) The number replicates <100. 

(b) The number whole plot treat- 
ments <100. 

(c) The number 
ments <100. 

(d) The product whole plot treat- 
ments times sub-plot treatments 
<300. 

(5) The restrictions 
plot program are: 

(a) The number replicates 

(b) The number whole plot treat- 
ments <32. 

(c) The number 
ment <50. 

(d) The number sub-sub-plot treat- 
ments <32. 

(e) (Whole plot treatments) (sub- 
plot treatments) (sub-sub-plot 
treatmeats) <200. 


This program was successtully run and 
sample problem and flow diagram are avail- 
able. Miss Betty Takvan, Assistant 
Librarian, Numerical Analysis Laboratory, 
University Arizona, Tucson, Arizona. 


Analysis Variance, BIMED No. 012, IBM 
709, March 1960 


This program written for complete 
factorial design. many variables may 
processed. There limitation the 
number replicates. The number cate- 
gories levels any variable cannot exceed 
999, and input data one replicate cannot 
exceed 20,000, namely: 


the variables, and 14. The program 
can also perform transformation the 
input data according the codes specified 
the control card. This program was success- 
fully run and sample problem available. 
Professor Dixon, Div. Biostatistics, 
Dept. Preventive Medicine and Public 
Health, School Medicine, University 
California Los Angeles, Los Angeles 24, 
California. 
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One and Two Analysis Variance, 


This program for computing the 
cal parameters necessary for the Analysis 
Variance one and two factor experiments. 
The ANOVA table including ratios, 
printed out the SCP (Supervisory Control 
Printer). addition, column and row sums 
are put output tape. 

The restrictions the routine are: 


300 


where the number levels for factor, 
the number levels for factor, the 
number replications per cell, the total 
the maximum number digits any 
observation. 

modified program also available, for 
input containing way experiments when 
desired eliminate the printing 
ANOVA tables the SCP. This program 
marked HSP (High Speed Printer) and 
follows the regular program the instruction 
tape. For the way experiments only, 
will prepare the ANOVA table for the high 
speed printer. This program was successfully 
run. sample problem nor diagram 


available. Anthony Brescia, Program Library 
Services, Remington Rand Univac, Div. 
Sperry Rand Corporation, 315 Park Ave., 
South, New York 10, 


Probit III, IBM 650, Indexing Accumu- 
lators and Floating Decimal 


This program fits regression line 
dosage-mortality other dose- 
response data. The method used that 
likelihood described Finney. 
The procedure iterative and normally 
stops when two successive regression co- 
efficients agree within 1/100th their 
standard error. Different tolerances can 
substituted. Maximum number doses 20. 
Maximum number iterations The pro- 
gram employs approximations for the normal 
curve which are significant minimally 
decimal places. Heterogeneity tested the 


test. Normal operation the program 
requires probability for significance 
tests. heterogeneity present, the hetero- 
geneity factor automatically included 
the appropriate places the computation. 
When the data are heterogeneous such 
degree that the regression not significant, 
the machine will punch out negative lower 
fiducial limit the regression coefficient 
(when The program was 
compiled means FORTRANSIT II. 

This program was successfully run. 
flow diagram nor sample problem available. 
Director, Computation Center, University 
Kansas, Lawrence, Kansas. 


Statistical Extensions for Runcible Sept. 
1959, IBM 650, Extensions are written 
650 machine language but are used part 
Runcible programming system. (May 
used connection with any other Runcible 
Extensions, 


These statistical extensions, when used 
within program written Runcible 
language, will compute the following statistics 
and/or probability functions: 

Data information, mean, covariance, alpha 
alpha simple correlation coefficient, 
standard deviation, highest value, lowest 
value, variance, simple linear regression 
equation, cross product, correlation matrix, 
sum variable, sum squares, sum third 
powers, sum fourth powers, floating point 
random numbers, function, cumula- 
tive normal probability, inverse cumulative 
normal probability, Poisson probability, 
cumulative Poisson probability, Binomial 
probability, cumulative Binomial probability, 
Binomial coefficients, Chi-square test, test 
Il, test, simultaneous linear equation 
solver, matrix inverse, fixed point random 
numbers. 

This report should regarded supple- 
ment the “RUNCIBLE and 
BLE EXTENSIONS—PART reports 
(available from Case Inst. Tech.). This 
program was successfully run and sample 
problem available. Director, Statistical 
Laboratory, Case Institute Technology, 
Cleveland Ohio. 
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NOTICES 


DoD H-109 


new handbook the Quality Control and Reliability series has been 
published the Office the Assistant Secretary Defense (S&L). DoD 
Handbook H-109, Procedures for Determining Validity Suppliers’ 
Attributes may purchased from the Superintendent Docu- 
ments, Government Printing Office, Washington 25, (price: 
cents). This handbook provides appropriate statistical tests and tables 
critical values for use determining the validity suppliers inspection records 
when sampling inspection attributes specified the contractual document. 


PROCEEDINGS, NATIONAL SYMPOSIA RELIABILITY 
AND ConTROL 


There have been six National Symposia Reliability and Quality Control, 
co-sponsored the American Society for Quality Control, the Institute 
Radio Engineers, Inc., the American Institute Electrical Engineers and the 
Electronic Industries Association. For each the Symposia paper-bound 
copy PROCEEDINGS was printed. Within the past year stocks four 
these—First, Second, Third and Fifth—were depleted. These four have now 
been reprinted and the PROCEEDINGS all six Symposia are now stock 
for prompt shipment. Orders for desired volumes, $5.00 net each volume 
postpaid, should sent the Editorial Department, Institute Radio 
Engineers, East 79th Street, New York 21, New York. 


New York MEETING 
AND STATISTICS FOR 


The Electronics Division ASQC and the Section Engineering and Physical 
Sciences, ASA, are sponsoring meeting and Statistics for 
Reliability Problems” held March and 28, 1961 New York City 
New York University’s Washington Square campus. There will be, addition 
program invited papers, several sessions for short contributed papers. 
These papers will restricted fifteen minutes presentation time. Persons 


having papers they feel merit presentation should send abstracts not exceed 
200 words to: 


Dr. Program Chairman 
Research Triangle Institute 

Post Office Box 490 

Durham, North Carolina 
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NOTICES 


NEBRASKA DEGREES STATISTICS 


The Mathematics Department the University Nebraska announces the 
introduction curriculum leading the M.A. M.S. and Ph.D. degrees 
Statistics. bachelor’s degree program Statistics also under considera- 
tion present. Courses are offered Statistical Methods, Statistics for Engi- 
neers, Theory Probability, Information Theory, Methods Experimental 
Design, Stochastic Processes, Theory Games and Statistical Decision Theory, 
and Topics Probability and Statistics. Additional courses will added 
needed. number assistantships and fellowships are available qualified 
students. For information concerning degree requirements and for information 
concerning assistantships, direct inquiries Professor Bernard Harris, Depart- 
ment Mathematics, University Nebraska, Lincoln Nebraska. 


INSTITUTE FoR CoLLEGE TEACHERS STATISTICS 


The National Science Foundation will sponsor Summer Institute for College 
Teachers Statistics Iowa State University for the period from 
June through August 18, 1961. The Departments Statistics three other 
universities, Kansas State, Utah State and the University Wyoming, are 
cooperating with Iowa State’s statistical center presenting this institute. 

Financial support the form stipends, dependency allowances and travel 
allowances will awarded eligible applicants. All American college and 
university teachers who are, who during the 1961-62 academic year will be, 
required teach one more courses statistics part their regular assign- 
ments are eligible for consideration. 

The institute planned provide additional basic training statistics 
for present and prospective teachers who, though well-grounded other fields, 
have limited backgrounds statistics. Also will provide more advanced 
courses and seminars designed keep college and university teachers abreast 
new developments. 

Courses are scheduled Statistical Methods, Theory Statistics, Experi- 
mental Design, Survey Designs, Topics Foundations Probability and 
Statistics, and Intermediate Applied Decision Theory. addition, op- 
portunity will provided for those interested observe demonstration class 
Principles Statistics the undergraduate level. The faculty will include 
the institute director, Dr. Bancroft, director the Iowa State University 
Statistical Laboratory and head, Department Statistics; Dr. Buehler, 
associate professor statistics, lowa State University; Dr. David, associate 
professor statistics, Iowa State University; Dr. Fryer, head the 
Department Statistics and Statistical Laboratory director, Kansas State 
University; Dr. Hartley, professor statistics, Iowa State University; 
the institute associate director, Dr. Huntsberger, associate professor 
statistics, State University; and Dr. Hurst, head the Department 
Applied Statistics and Statistical Laboratory director, Utah State University. 
Guest lecturers will present series special seminars. 

Requests for information application forms should addressed to: The 
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Director, Summer Institute Statistics, 102 Service Building, Iowa State 
University, Ames, Iowa. 


REGIONAL GRADUATE SUMMER SESSION STATISTICS 
VIRGINIA INSTITUTE 


The 1961 session the Southern Regional Graduate Summer Session 
Statistics will held the Virginia Polytechnic Institute, Blacksburg, Virginia, 
from June July 22, 1961. Blacksburg 2100 feet high the plateau 
the Allegheny Mountains and offers delightfully cool summer climate. 

The Virginia Polytechnic Institute, Oklahoma State University, North 
Carolina State College, and the University Florida have agreed operate 
continuing program graduate summer sessions statistics held 
each institution rotation. The program was instituted Virginia Polytechnic 
Institute the summer 1954. 

The 1961 session, like previous sessions under this program, intended 
serve: teachers statistics and mathematics; professional workers who 
want formal training modern statistics; research and engineering personnel 
who want intensive instruction basic statistical concepts and modern statistical 
methodology; Public Health statisticians who wish keep informed about 
advanced specialized theory and methods; prospective candidates for graduate 
degrees statistics; and graduate students other fields who desire sup- 
porting work statistics. 

The session will last six weeks and courses will carry five quarter hours 
credit. Not more than two courses may taken for credit any one session. 
The summer work statistics may applied residence credit any the 
cooperating institutions, well certain other universities, partial fulfillment 
the requirements for graduate degree. The program may entered 
any session, and consecutive courses will follow successive summers that 
would possible for student complete the course work statistics for 
Master’s degree three summers. Students must satisfy the remaining re- 
quirements for course work and thesis the institution where they are 
admitted candidacy. The advanced courses may accepted part the 
Ph.D. program the participating institutions. 

limited number fellowships will available for applicants from certain 
specialized areas. Doctoral courtesy will honored for those holding Ph.D. 
M.D. degrees. 

The courses offered statistics 1961 the Virginia Polytechnic 
Institute are follows: Statistical Methods, Sampling Theory; Applied Statistics 
for Engineers and Physical Sciences; Theory Probability; Theory Statistical 
Inference; Theory III, Theory Linear Hypotheses; Non-parametric Methods; 
and Multivariate Methods. 

number courses advanced mathematics will available during the 
Summer Session. For complete listing please consult the University timetable. 
series Colloquia involving recent developments statistical theory and 
methods will conducted during the special Summer Session. 
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current industrial and military problems. 


author well known book probability statistics. 


Division Adult Education. 


Lafayette, ten-day short course The Mathematical Techniques 
Operations Research will offered Purdue University for the second time 
this summer, according Prof. Paul Randolph, the department mathe- 
matics and statistics, director the short course. The dates the course are 


The course has been designed specifically for statisticians, quality control 
analysts, engineers, and other technical personnel industrial and management 
positions, Professor Randolph stated. Emphasis will placed the mathe- 
matical techniques operations research and the application these methods 


These methods involve the construction mathematical models representing 
the operation industrial management military organization, and suggest 
the best solutions problems involved. Among the topics discussed 
during the course are inventory control models, waiting line models, linear 
programming, simplex method, transportation methods, production scheduling 
models, search theory, cost-effectiveness studies and systems analysis. 

Two outstanding leaders this field have been selected instructors for 
the short course. Dr. Albert Madansky, the University California 
Los Angeles, did basic work stochastic linear programming for the Rand 
Corporation, Santa Monica, Calif. Dr. Bernard Lindgren, the Institute 
Technology the University Minnesota, and formerly National Science 
Foundation scholar Operations Research Stanford University, the co- 


The course sponsored Purdue’s Statistical Laboratory and Division 
Adult Education. Further information may obtained writing the 
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Errata 


New Three Level Designs for the Study 
Quantitative Variables” 


This paper should carry the acknowledgement: 


“This work was supported part the Department the Army, Project No. 
99-01-004, Ordnance Project PB2-0001, OOR Project No. 1715, 


Contract No. DA-36-034-Ord 2297 through the Statistical Techniques Research 
Group, Princeton University.” 


“The Effect Sequential Batching for Acceptance-Rejection Sampling 
Upon Sample Assurance Total Product Quality” 


Formula 2.1, 21, should read: 
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TABLES 
THE HYPERGEOMETRIC 
PROBABILITY DISTRIBUTION 


Gerald Lieberman and Donald Owen. For the first 
time, the hypergeometric probability distribution exten- 
sively tabulated and the results exact machine computa- 
tion are available. great use mathematics, statistics, the 
social and physical sciences, and engineering. Stanford 
Studies Mathematics and Statistics, $15.00 


STUDIES ITEM ANALYSIS 
AND PREDICTION 


Edited Herbert Solomon. This integrated series mathe- 
matical studies presents many new theoretical develop- 
ments both test design and the classification individuals 
the basis responses tests. Stanford Mathematical 
Studies the Social Sciences, VI. About 


MARKOV LEARNING 
MODELS FOR MULTIPERSON 
INTERACTIONS 


Patrick Suppes and Richard Atkinson. major attempt 
bridge the gap between statistical learning theory and 
social psychology applying stimulus-sampling techniques 
social interaction situations. Stanford Mathematical 
Studies the Social Sciences, 


Order from your bookstore, please 


Stanford University Press 
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PREPARATION MANUSCRIPTS 


Manuscripts should submitted the office the editor: Hunter, 
Research Center, Army; The University Wisconsin; 
Madison, Wisconsin. Each manuscript should typewritten, spaced, 
with wide margins sides, top, and bottom. The original should submitted 
with two additional copies, paper that will take corrections. Dittoed 
mimeographed papers are acceptable only completely legible. Footnotes 
should avoided and replaced remarks the text, placed appendix. 
Preferably, references the manuscript should appear (Jones, B., 1958). 
and again later alphabetical order list references. Alternatively, refer- 
ences may numbered, e.g. [1], they appear the manuscript and listed 
this sequence the list references. the reference list, each reference 
should contain, the order indicated, the name and initials the author 
followed those the co-authors, date publication, title reference, 
source, number and page. References books should include pub- 
lisher’s name and location. 

Figures, charts, and diagrams should professionally drawn plain white 
paper tracing cloth black India ink twice the size they are printed. 
full page diagram, print, measures 7.25 4.75 inches. 

far possible, formulas should typewritten and symbols not available 
typewriter carefully inserted Authors are asked keep mind the 
typographical difficulties complicated mathematical formulae. The difference 
between capital and lower-case letters should clearly shown; care should 
taken avoid confusion between such pairs zero and the letter the numeral 
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clearly below above the line. Bars above groups letters (e.g., log and 
underlined letters (e.g., difficult print and should avoided. Symbols 
are automatically italicized the printer and should not underlined 
Boldface letters may indicated underlining with wavy line 
the manuscript; boldface subscripts and superscripts are not available. 
Complicated exponentials should represented with the symbol exp 
larly when appearing the text, that is, 


writing square roots the fractional exponent preferable the radical sign. 
Fractions the body the text (and when possible displayed expressions) 
and fractions occurring the numerators denominators fractions are 
preferably written with the solidus; thus 


Authors will ordinarily receive only galley proofs. Fifty offprints without 
covers will furnished free. Costs for additional reprints and covers can 
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The purpose contribute the development and use statistical 
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premium succinct communication among the physical scientist, engineer, statistician 
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techniques expected useful these sciences, papers illustrating the application known 
statistical methods new novel environments, expository tutorial papers partic- 
ular statistical methods, and papers dealing with the philosophy and problems applying 
statistical methods research, development, design and performance. Brief descriptions 
problems requiring solution and short technical notes will also accepted for publication. 
the Editor, signed the author and limited length will published when 
they are considered timely and appropriate. All papers should contain short but clear 
summary contents and conclusions, expository section containing numerical examples 

whenever practicable, and appropriate additional sections relating technical derivations. 
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